Jul 20 22:22:57.170699 ip-10-0-136-15 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.536893    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542261    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542273    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542277    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542282    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542285    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542289    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542294    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:57.553007 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542298    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542303    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542306    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542310    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542313    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542317    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542320    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542322    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542326    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542330    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542333    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542336    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542339    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542342    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542345    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542348    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542352    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542355    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542357    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542374    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542378    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:57.556708 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542382    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542386    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542389    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542391    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542395    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542398    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542401    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542404    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542408    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542411    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542414    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542418    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542422    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542424    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542426    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542430    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542433    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542438    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542442    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:57.557771 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542445    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542449    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542455    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542458    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542461    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542464    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542468    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542471    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542473    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542476    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542480    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542483    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542485    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542488    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542493    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542496    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542499    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542504    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542507    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:57.560566 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542510    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542513    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542517    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542520    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542531    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542534    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542537    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542540    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542544    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542547    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542549    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542553    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542556    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542559    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542562    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542565    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542569    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542572    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542576    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542579    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:57.561219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542582    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542585    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542587    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542590    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542593    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542595    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542599    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542602    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542605    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542607    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542610    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542614    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.542616    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543360    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543382    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543386    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543390    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543393    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543396    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543400    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:57.563819 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543403    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543406    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543408    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543412    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543415    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543420    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543425    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543428    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543431    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543434    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543437    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543441    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543445    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543448    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543451    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543454    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543458    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543461    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543463    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543467    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:57.564470 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543469    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543472    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543475    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543478    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543481    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543484    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543486    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543489    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543493    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543495    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543499    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543503    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543505    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543508    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543511    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543515    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543518    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543521    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543526    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543529    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:57.566679 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543531    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543534    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543538    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543541    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543544    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543548    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543552    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543555    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543557    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543561    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543564    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543567    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543569    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543575    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543578    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543582    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543585    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543589    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543592    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:57.567739 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543595    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543599    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543602    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543605    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543608    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543612    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543615    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543617    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543620    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543624    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543627    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543629    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543633    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543636    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543639    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543641    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543644    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543647    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543649    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:57.570900 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543652    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543655    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543659    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543661    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543664    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543667    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543670    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543672    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543675    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543677    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543681    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543683    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543686    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.543688    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544079    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544085    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544090    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544095    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544099    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544102    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:57.571539 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544105    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544109    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544113    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544116    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544119    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544123    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544126    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544129    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544132    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544136    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544139    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544142    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544146    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544150    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544152    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544155    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544159    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544162    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544164    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544167    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:57.574702 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544170    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544174    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544176    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544179    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544186    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544188    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544191    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544194    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544198    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544200    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544204    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544207    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544211    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544214    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544216    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544219    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544223    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544226    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544228    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:57.575324 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544232    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544235    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544237    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544240    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544242    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544247    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544249    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544252    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544254    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544257    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544261    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544264    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544268    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544272    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544274    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544277    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544280    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544285    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544287    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:57.575947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544290    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544294    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544297    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544300    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544304    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544307    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544311    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544314    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544319    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544322    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544324    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544327    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544331    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544334    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544336    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544340    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544342    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544345    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544347    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:57.663516 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544350    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:57.637575 ip-10-0-136-15 systemd[1]: Started Kubernetes Kubelet.
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544353    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544356    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544358    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544375    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544378    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544381    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544383    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544387    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544390    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544393    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544398    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544401    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544403    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544406    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.544410    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544482    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544490    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544496    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544501    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544505    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 22:22:57.664815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544508    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544512    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544520    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544524    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544529    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544532    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544537    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544541    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544544    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544547    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544551    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544554    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544557    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544564    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544567    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544571    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544576    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544580    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544585    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544588    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544591    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544595    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544600    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544603    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 22:22:57.666085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544606    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544611    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544614    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544618    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544623    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544626    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544629    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544634    2572 flags.go:64] FLAG: --enable-server="true"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544637    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544641    2572 flags.go:64] FLAG: --event-burst="100"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544645    2572 flags.go:64] FLAG: --event-qps="50"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544648    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544651    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544655    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544659    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544662    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544665    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544669    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544672    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544675    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544679    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544683    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544686    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544689    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544694    2572 flags.go:64] FLAG: --feature-gates=""
Jul 20 22:22:57.668403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544698    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544702    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544705    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544708    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544711    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544716    2572 flags.go:64] FLAG: --help="false"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544719    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-136-15.ec2.internal"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544723    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544726    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544729    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544733    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544738    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544741    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544743    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544748    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544752    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544755    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544759    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544762    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544766    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544770    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544774    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544776    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544780    2572 flags.go:64] FLAG: --lock-file=""
Jul 20 22:22:57.669680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544784    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544788    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544791    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544797    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544800    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544803    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544807    2572 flags.go:64] FLAG: --logging-format="text"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544810    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544813    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544817    2572 flags.go:64] FLAG: --manifest-url=""
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544820    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544825    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544829    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544835    2572 flags.go:64] FLAG: --max-pods="110"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544838    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544842    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544845    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544848    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544851    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544855    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544858    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544866    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544869    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544872    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 22:22:57.672233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544876    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544880    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544886    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544889    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544894    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544897    2572 flags.go:64] FLAG: --port="10250"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544900    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544905    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-043a84e52e6c06df2"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544909    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544912    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544916    2572 flags.go:64] FLAG: --register-node="true"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544918    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544922    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544925    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544928    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544930    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544935    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544939    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544942    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544945    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544949    2572 flags.go:64] FLAG: --runonce="false"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544953    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544957    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544961    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544964    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 22:22:57.673317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544967    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544972    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544975    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544978    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544981    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544985    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544988    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544991    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544996    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.544999    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545001    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545009    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545012    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545015    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545021    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545024    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545027    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545031    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545034    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545036    2572 flags.go:64] FLAG: --v="2"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545040    2572 flags.go:64] FLAG: --version="false"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545046    2572 flags.go:64] FLAG: --vmodule=""
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545050    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.545054    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 22:22:57.676089 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545176    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545181    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545184    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545187    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545193    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545196    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545199    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545202    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545207    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545210    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545212    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545216    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545220    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545222    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545225    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545227    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545231    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545235    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545237    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545241    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:57.677183 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545245    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545247    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545250    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545252    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545256    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545261    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545265    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545268    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545272    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545274    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545277    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545280    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545283    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545286    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545288    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545291    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545296    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545299    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545301    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545304    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:57.768744 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545307    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545310    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545313    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545315    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545318    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545322    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545325    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545328    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545332    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545334    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545339    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545342    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545345    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545347    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545351    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545354    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545357    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545360    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545376    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545379    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:57.769980 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545382    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545384    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545387    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545390    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545394    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545397    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545399    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545403    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545407    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545411    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545415    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545419    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545421    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545424    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545427    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545431    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545434    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545436    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545439    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545443    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:57.770851 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545446    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545449    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545453    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545458    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545461    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545464    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545467    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545470    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545472    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545476    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545479    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545482    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545484    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545489    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545493    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545495    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545499    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545504    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:57.772351 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.545507    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.546181    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.555255    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.555273    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.556122    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.556142    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556293    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556300    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556306    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556312    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556316    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556325    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556329    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556333    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:57.774815 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556337    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556341    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556344    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556347    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556351    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556354    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556358    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556382    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556388    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556393    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556401    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556405    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556409    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556412    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556416    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556420    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556424    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556428    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556432    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556435    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:57.796961 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556439    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556445    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556453    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556457    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556461    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556464    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556468    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556472    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556475    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556479    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556482    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556486    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556490    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556493    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556496    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556504    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556507    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556511    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556514    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:57.797855 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556518    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556521    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556525    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556528    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556532    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556540    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556543    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556551    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556558    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556562    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556565    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556569    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556573    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556576    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556581    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556585    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556589    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556593    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556596    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556600    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:57.798948 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556603    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556610    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556614    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556618    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556621    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556625    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556628    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556632    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556635    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556639    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556642    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556646    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556649    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556657    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556662    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556666    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556671    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556675    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556679    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556686    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:57.800698 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556691    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556700    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556704    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556708    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556713    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556723    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556730    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556735    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556740    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556744    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556750    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.556754    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.556763    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557163    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557172    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:57.801510 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557178    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557183    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557189    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557193    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557198    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557203    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557215    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557222    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557227    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557232    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557236    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557241    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557245    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557250    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557254    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557259    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557263    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557270    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557274    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:57.802087 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557283    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557287    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557292    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557297    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557302    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557306    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557312    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557320    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557325    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557330    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557334    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557339    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557348    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557355    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557379    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557385    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557390    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557394    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557399    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:57.802826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557404    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557408    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557412    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557417    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557422    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557431    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557436    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557440    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557446    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557451    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557456    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557462    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557467    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557471    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557476    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557480    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557485    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557489    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557499    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:57.803540 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557503    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557508    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557513    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557518    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557523    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557527    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557531    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557536    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557540    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557545    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557549    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557560    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557564    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557568    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557573    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557577    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557581    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557585    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557589    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557594    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:57.804290 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557598    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557602    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557607    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557611    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557623    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557628    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557633    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557637    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557642    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557647    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557651    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557656    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557661    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557665    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557669    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557673    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557681    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557685    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557689    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:57.805066 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:22:57.557693    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.557699    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.557936    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.564556    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.567057    2572 server.go:1019] "Starting client certificate rotation"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.567899    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.567935    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.572552    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.576893    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.587884    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.592186    2572 log.go:25] "Validated CRI v1 image API"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.593002    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 22:22:57.805791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.597753    2572 fs.go:135] Filesystem UUIDs: map[0f61bdda-93e2-4fe8-8511-0fd5b72de888:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 eded6cad-0514-4343-a91f-80da03cf6390:/dev/nvme0n1p4]
Jul 20 22:22:57.806258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.597770    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 22:22:57.806302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.602858    2572 manager.go:216] Machine: {Timestamp:2026-07-20 22:22:57.601590295 +0000 UTC m=+0.318173872 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3131600 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26c940ca5a575c9019c582f73b9100 SystemUUID:ec26c940-ca5a-575c-9019-c582f73b9100 BootID:c6e6255b-ed15-4b0e-b376-d30109212a8d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:45:d4:89:df:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:45:d4:89:df:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:37:e3:44:a2:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 22:22:57.806302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.602961    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 22:22:57.806302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.603074    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 22:22:57.806302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.603516    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 22:22:57.806302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.606168    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 22:22:57.806302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.606197    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-15.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 22:22:57.806302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.606903    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.606913    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.606921    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.606935    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.608564    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618242    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618354    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618419    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618433    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618446    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618457    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618467    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618772    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.618788    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.621764    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.623518    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.623545    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624868    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624882    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624888    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624894    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624904    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624910    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624919    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624924    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624930    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624936    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624944    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.624951    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.625700    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.625707    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.629344    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qf6ml"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.629788    2572 server.go:1268] "Started kubelet"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.630021    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.636993    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.637151    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.637309    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-15.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.638108    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qf6ml"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.638388    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 22:22:57.806641 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.638602    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-15.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.638823    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.639409    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.641201    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.649425    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.649489    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.649501    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650094    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650108    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650176    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650188    2572 factory.go:55] Registering systemd factory
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650203    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650251    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650260    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650500    2572 factory.go:153] Registering CRI-O factory
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650518    2572 factory.go:223] Registration of the crio container factory successfully
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650567    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650591    2572 factory.go:103] Registering Raw factory
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650606    2572 manager.go:1196] Started watching for new ooms in manager
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.650901    2572 manager.go:349] Starting recovery of all containers
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.651573    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-15.ec2.internal.18c41fac64b19cb8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-15.ec2.internal,UID:ip-10-0-136-15.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-15.ec2.internal,},FirstTimestamp:2026-07-20 22:22:57.6297566 +0000 UTC m=+0.346340176,LastTimestamp:2026-07-20 22:22:57.6297566 +0000 UTC m=+0.346340176,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-15.ec2.internal,}"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.660490    2572 manager.go:354] Recovery completed
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.662050    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.663683    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.665786    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.665907    2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-15.ec2.internal\" not found" node="ip-10-0-136-15.ec2.internal"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.686296    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.686328    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.686343    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.687344    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.687357    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.687392    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.687427    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.688469    2572 policy_none.go:49] "None policy: Start"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.688484    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.688494    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 22:22:57.808102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.689071    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.689099    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.689110    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.689418    2572 policy_none.go:47] "Start"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.750245    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.756015    2572 manager.go:337] "Starting Device Plugin manager"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.756044    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.756053    2572 server.go:87] "Starting device plugin registration server"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.756336    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.756348    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.756482    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.756561    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.756572    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.757199    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 22:22:57.809495 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.757250    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:57.837572 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.837545    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 22:22:57.837685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.837592    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 22:22:57.837685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.837619    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 22:22:57.837685 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.837660    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 22:22:57.839822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.839805    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:57.857000 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.856978    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:57.857768 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.857753    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:57.857823 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.857789    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:57.857823 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.857805    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:57.857886 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.857829    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-15.ec2.internal"
Jul 20 22:22:57.866168 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:57.866152    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-15.ec2.internal"
Jul 20 22:22:57.866212 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.866173    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-15.ec2.internal\": node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:57.882031 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:57.882010    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:59.263490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.263467    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"]
Jul 20 22:22:59.263552 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.263537    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:59.265135 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.265119    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:59.265222 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.265150    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:59.265222 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.265160    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:59.267525 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.267514    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:59.267653 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.267639    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.267684 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.267674    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:59.268292 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.268277    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:59.268337 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.268277    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:59.268337 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.268330    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:59.268392 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.268342    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:59.268392 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.268306    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:59.268456 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.268407    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:59.270795 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.270776    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.270873 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.270806    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:59.271420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.271405    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:59.271486 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.271429    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:59.271486 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.271438    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:59.276671 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.276654    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c907d48106b2307f2766163a9d53737a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal\" (UID: \"c907d48106b2307f2766163a9d53737a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.276774 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.276678    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c907d48106b2307f2766163a9d53737a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal\" (UID: \"c907d48106b2307f2766163a9d53737a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.276774 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.276708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/004c5084a01cb59f72fdfadb659205a4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-15.ec2.internal\" (UID: \"004c5084a01cb59f72fdfadb659205a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.303417 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.303393    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-15.ec2.internal\" not found" node="ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.307737 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.307724    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:59.307825 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.307813    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-15.ec2.internal\" not found" node="ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.376890 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.376827    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c907d48106b2307f2766163a9d53737a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal\" (UID: \"c907d48106b2307f2766163a9d53737a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.376890 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.376856    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c907d48106b2307f2766163a9d53737a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal\" (UID: \"c907d48106b2307f2766163a9d53737a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.376890 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.376873    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/004c5084a01cb59f72fdfadb659205a4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-15.ec2.internal\" (UID: \"004c5084a01cb59f72fdfadb659205a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.377053 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.376931    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c907d48106b2307f2766163a9d53737a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal\" (UID: \"c907d48106b2307f2766163a9d53737a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.377053 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.376959    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c907d48106b2307f2766163a9d53737a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal\" (UID: \"c907d48106b2307f2766163a9d53737a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.377053 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.376931    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/004c5084a01cb59f72fdfadb659205a4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-15.ec2.internal\" (UID: \"004c5084a01cb59f72fdfadb659205a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.408163 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.408144    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:59.508752 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.508725    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:59.606245 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.606210    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.609345 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.609324    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:59.613420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.613405    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.709900 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.709812    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:59.810291 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.810263    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-15.ec2.internal\" not found"
Jul 20 22:22:59.815085 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.815059    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:59.875977 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.875950    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.889389 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.889371    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 22:22:59.890950 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.890937    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.891462 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.891442    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 22:22:59.891592 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.891573    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 22:22:59.891655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.891588    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 22:22:59.891655 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.891598    2572 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://ab8b56e83c0684c21922a34ac04b63b1-da1461369509dfbd.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/kube-system/pods\": read tcp 10.0.136.15:48224->3.90.122.99:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:22:59.891655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.891578    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 22:22:59.944767 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.944724    2572 apiserver.go:52] "Watching apiserver"
Jul 20 22:22:59.959989 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.959919    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 22:22:59.961269 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.960804    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-b7hjs","openshift-network-diagnostics/network-check-target-74244","openshift-ovn-kubernetes/ovnkube-node-bszzl","kube-system/konnectivity-agent-4zbpd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78","openshift-dns/node-resolver-p4trw","openshift-multus/multus-additional-cni-plugins-4xlq8","openshift-network-operator/iptables-alerter-mqvbx","kube-system/global-pull-secret-syncer-rhs8q","openshift-cluster-node-tuning-operator/tuned-89lmn","openshift-image-registry/node-ca-f9qht","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal","openshift-multus/multus-fkvmr"]
Jul 20 22:22:59.963554 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.963532    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:22:59.963632 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.963596    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:22:59.966306 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.966280    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:22:59.966392 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.966376    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:22:59.968307 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.968271    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 22:17:58 +0000 UTC" deadline="2027-12-30 11:04:32.066209424 +0000 UTC"
Jul 20 22:22:59.968307 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.968305    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12660h41m32.097907023s"
Jul 20 22:22:59.968636 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.968599    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.970779 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.970761    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:22:59.971072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.971031    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 22:22:59.971072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.971046    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 22:22:59.971072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.971068    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 22:22:59.971262 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.971088    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sm9tx\""
Jul 20 22:22:59.971262 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.971103    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 22:22:59.971484 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.971466    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 22:22:59.971484 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.971480    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 22:22:59.973141 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.973128    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:22:59.973931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.973916    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t7h28\""
Jul 20 22:22:59.973984 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.973923    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 22:22:59.974144 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.974131    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 22:22:59.975148 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.975125    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 22:22:59.975332 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.975320    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:22:59.975490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.975470    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 22:22:59.975725 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.975711    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 22:22:59.975873 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.975860    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 22:22:59.975911 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.975894    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wxv2b\""
Jul 20 22:22:59.977554 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.977542    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.979748 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.979732    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:22:59.980168 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-cni-bin\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980221 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovnkube-script-lib\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980221 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67022b7a-0606-461d-8ddc-5b3582a485ad-agent-certs\") pod \"konnectivity-agent-4zbpd\" (UID: \"67022b7a-0606-461d-8ddc-5b3582a485ad\") " pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:22:59.980221 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980207    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67022b7a-0606-461d-8ddc-5b3582a485ad-konnectivity-ca\") pod \"konnectivity-agent-4zbpd\" (UID: \"67022b7a-0606-461d-8ddc-5b3582a485ad\") " pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:22:59.980307 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980239    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-socket-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:22:59.980307 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-system-cni-dir\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.980307 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980299    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfgmp\" (UniqueName: \"kubernetes.io/projected/6d7b2314-23d4-4538-973f-ec96e28a1b7f-kube-api-access-jfgmp\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:22:59.980387 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-systemd-units\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-run-netns\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980451 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980411    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-ovn\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980482 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980449    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-log-socket\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980519 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980486    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.980568 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980519    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:22:59.980568 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980538    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-var-lib-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980568 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980552    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-cni-netd\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980682 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980573    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-env-overrides\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980682 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zwn8\" (UniqueName: \"kubernetes.io/projected/d73b29df-82d7-4184-b070-648cd7f9d3d1-kube-api-access-9zwn8\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980682 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980620    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-device-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:22:59.980682 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980650    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-systemd\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980831 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovn-node-metrics-cert\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.980831 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980734    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/becf7578-ba19-449d-a011-59cc584d9f17-hosts-file\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:22:59.980831 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88cpm\" (UniqueName: \"kubernetes.io/projected/becf7578-ba19-449d-a011-59cc584d9f17-kube-api-access-88cpm\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:22:59.980831 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980769    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:22:59.980831 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-sys-fs\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:22:59.981030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980829    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ck9m\" (UniqueName: \"kubernetes.io/projected/d918307f-b267-491e-a555-cbeb00e1f099-kube-api-access-2ck9m\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:22:59.981030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980853    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-cnibin\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.981030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980870    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.981030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovnkube-config\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.981030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:22:59.981030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980953    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:22:59.981030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-slash\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.981030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.980997    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-registration-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981048    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981092    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-os-release\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knww4\" (UniqueName: \"kubernetes.io/projected/504a25f5-9b0c-4111-b516-0c1345759490-kube-api-access-knww4\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981222    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-etc-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-node-log\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981264    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/becf7578-ba19-449d-a011-59cc584d9f17-tmp-dir\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981326    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-kubelet\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981360    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 22:22:59.981371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981359    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 22:22:59.981863 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981408    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.981863 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981464    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:22:59.981863 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981664    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9jct\""
Jul 20 22:22:59.981863 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981713    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 22:22:59.981863 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981756    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 22:22:59.981863 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981815    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 22:22:59.981863 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981716    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 22:22:59.982158 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.981938    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 22:22:59.982158 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.982007    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xffm5\""
Jul 20 22:22:59.982237 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.982165    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 22:22:59.982322 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.982290    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:22:59.982468 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:22:59.982384    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:22:59.983217 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.982837    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8k6pw\""
Jul 20 22:22:59.983217 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.982992    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 22:22:59.983217 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.983053    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:22:59.986778 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.986760    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:22:59.989064 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.989046    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:22:59.989165 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.989068    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 22:22:59.989349 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.989331    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9nlt5\""
Jul 20 22:22:59.989394 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.989339    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:22:59.991330 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.991315    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fkvmr"
Jul 20 22:22:59.991621 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.991601    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 22:22:59.991683 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.991620    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 22:22:59.991683 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.991631    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 22:22:59.991783 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.991704    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pjmsb\""
Jul 20 22:22:59.991783 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.991706    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 22:22:59.993481 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.993467    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 22:22:59.993859 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:22:59.993847    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xd5v6\""
Jul 20 22:23:00.012047 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.012023    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wf7gw"
Jul 20 22:23:00.018721 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.018680    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wf7gw"
Jul 20 22:23:00.055993 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.055971    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:00.078852 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.078830    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 22:23:00.081704 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081676    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-cni-multus\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.081780 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.081780 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081741    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-cnibin\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.081780 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081759    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:00.081925 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-var-lib-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.081925 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081829    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-var-lib-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.081925 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081836    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-device-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.081925 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.081870    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:00.081925 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-kubelet\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.081925 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.081927    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs podName:6d7b2314-23d4-4538-973f-ec96e28a1b7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:00.581906234 +0000 UTC m=+1.973161450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs") pod "network-metrics-daemon-b7hjs" (UID: "6d7b2314-23d4-4538-973f-ec96e28a1b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081921    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-modprobe-d\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081939    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-device-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081967    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovn-node-metrics-cert\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.081992    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88cpm\" (UniqueName: \"kubernetes.io/projected/becf7578-ba19-449d-a011-59cc584d9f17-kube-api-access-88cpm\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-cni-binary-copy\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082042    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjwdw\" (UniqueName: \"kubernetes.io/projected/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-kube-api-access-wjwdw\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082065    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-run\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovnkube-config\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082147    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-slash\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-registration-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082201    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.082281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082240    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-systemd\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082244    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082279    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-slash\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8da648a-bff4-4bba-8a02-637d3feed260-tmp\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082307    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-registration-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082332    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082359    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-system-cni-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082381    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a443e5c-f716-48e6-a89e-8c31553f7131-host-slash\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082415    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-kubernetes\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082406    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysctl-conf\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082468    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-etc-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-node-log\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082514    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/becf7578-ba19-449d-a011-59cc584d9f17-tmp-dir\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082519    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.083014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082521    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-etc-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-daemon-config\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082557    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-node-log\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-kubelet\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082710    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082720    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-kubelet\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082734    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-cni-bin\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082752    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-openvswitch\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-cni-bin\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082768    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67022b7a-0606-461d-8ddc-5b3582a485ad-konnectivity-ca\") pod \"konnectivity-agent-4zbpd\" (UID: \"67022b7a-0606-461d-8ddc-5b3582a485ad\") " pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082805    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-run-ovn-kubernetes\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082826    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-system-cni-dir\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfgmp\" (UniqueName: \"kubernetes.io/projected/6d7b2314-23d4-4538-973f-ec96e28a1b7f-kube-api-access-jfgmp\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:00.084087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082861    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/becf7578-ba19-449d-a011-59cc584d9f17-tmp-dir\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082878    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-kubelet-config\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-dbus\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-lib-modules\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082903    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovnkube-config\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.082932    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-system-cni-dir\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083008    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8da648a-bff4-4bba-8a02-637d3feed260-etc-tuned\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-sys-fs\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzdb9\" (UniqueName: \"kubernetes.io/projected/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-kube-api-access-vzdb9\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-cni-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-os-release\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083118    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083110    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-sys-fs\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083139    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-cni-netd\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.084685 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083161    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-env-overrides\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083185    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-systemd\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083205    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/becf7578-ba19-449d-a011-59cc584d9f17-hosts-file\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083225    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-cni-netd\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083263    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083280    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-systemd\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083291    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ck9m\" (UniqueName: \"kubernetes.io/projected/d918307f-b267-491e-a555-cbeb00e1f099-kube-api-access-2ck9m\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-k8s-cni-cncf-io\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083361    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zwn8\" (UniqueName: \"kubernetes.io/projected/d73b29df-82d7-4184-b070-648cd7f9d3d1-kube-api-access-9zwn8\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083384    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-multus-certs\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-sys\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083435    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-cnibin\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083510    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-netns\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.085149 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083524    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/becf7578-ba19-449d-a011-59cc584d9f17-hosts-file\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-conf-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/67022b7a-0606-461d-8ddc-5b3582a485ad-konnectivity-ca\") pod \"konnectivity-agent-4zbpd\" (UID: \"67022b7a-0606-461d-8ddc-5b3582a485ad\") " pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083605    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-hostroot\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-var-lib-kubelet\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083667    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrz2r\" (UniqueName: \"kubernetes.io/projected/c8da648a-bff4-4bba-8a02-637d3feed260-kube-api-access-zrz2r\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083672    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-etc-selinux\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-socket-dir-parent\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083710    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-env-overrides\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083713    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-cni-binary-copy\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-os-release\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083774    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-cnibin\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.085535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083841    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knww4\" (UniqueName: \"kubernetes.io/projected/504a25f5-9b0c-4111-b516-0c1345759490-kube-api-access-knww4\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083842    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/504a25f5-9b0c-4111-b516-0c1345759490-os-release\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-serviceca\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.083976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-cni-bin\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084011    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-etc-kubernetes\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084038    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a443e5c-f716-48e6-a89e-8c31553f7131-iptables-alerter-script\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084065    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovnkube-script-lib\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67022b7a-0606-461d-8ddc-5b3582a485ad-agent-certs\") pod \"konnectivity-agent-4zbpd\" (UID: \"67022b7a-0606-461d-8ddc-5b3582a485ad\") " pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084115    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-socket-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084141    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxtqq\" (UniqueName: \"kubernetes.io/projected/0a443e5c-f716-48e6-a89e-8c31553f7131-kube-api-access-fxtqq\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084153    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysconfig\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084187    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysctl-d\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084208    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-host\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.086030 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-systemd-units\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084256    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-run-netns\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084270    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/504a25f5-9b0c-4111-b516-0c1345759490-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d918307f-b267-491e-a555-cbeb00e1f099-socket-dir\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-ovn\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084328    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-run-ovn\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084332    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-systemd-units\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084358    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-log-socket\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084377    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-host-run-netns\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084399    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-host\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084425    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d73b29df-82d7-4184-b070-648cd7f9d3d1-log-socket\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.084645    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovnkube-script-lib\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.086113    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d73b29df-82d7-4184-b070-648cd7f9d3d1-ovn-node-metrics-cert\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.086492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.086308    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/67022b7a-0606-461d-8ddc-5b3582a485ad-agent-certs\") pod \"konnectivity-agent-4zbpd\" (UID: \"67022b7a-0606-461d-8ddc-5b3582a485ad\") " pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:00.094749 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.094719    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:00.094749 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.094747    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:00.095011 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.094760    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lct2c for pod openshift-network-diagnostics/network-check-target-74244: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:00.095011 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.094833    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c podName:aff9386a-9259-4ab3-875e-cf6c0fdeee7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:00.594813981 +0000 UTC m=+1.986069156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lct2c" (UniqueName: "kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c") pod "network-check-target-74244" (UID: "aff9386a-9259-4ab3-875e-cf6c0fdeee7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:00.096042 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.096017    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfgmp\" (UniqueName: \"kubernetes.io/projected/6d7b2314-23d4-4538-973f-ec96e28a1b7f-kube-api-access-jfgmp\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:00.096232 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.096215    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88cpm\" (UniqueName: \"kubernetes.io/projected/becf7578-ba19-449d-a011-59cc584d9f17-kube-api-access-88cpm\") pod \"node-resolver-p4trw\" (UID: \"becf7578-ba19-449d-a011-59cc584d9f17\") " pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:23:00.097353 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.097335    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knww4\" (UniqueName: \"kubernetes.io/projected/504a25f5-9b0c-4111-b516-0c1345759490-kube-api-access-knww4\") pod \"multus-additional-cni-plugins-4xlq8\" (UID: \"504a25f5-9b0c-4111-b516-0c1345759490\") " pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.097495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.097476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zwn8\" (UniqueName: \"kubernetes.io/projected/d73b29df-82d7-4184-b070-648cd7f9d3d1-kube-api-access-9zwn8\") pod \"ovnkube-node-bszzl\" (UID: \"d73b29df-82d7-4184-b070-648cd7f9d3d1\") " pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.097553 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.097503    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ck9m\" (UniqueName: \"kubernetes.io/projected/d918307f-b267-491e-a555-cbeb00e1f099-kube-api-access-2ck9m\") pod \"aws-ebs-csi-driver-node-p2g78\" (UID: \"d918307f-b267-491e-a555-cbeb00e1f099\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.185217 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-cnibin\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-kubelet\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-modprobe-d\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185279    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-cni-binary-copy\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjwdw\" (UniqueName: \"kubernetes.io/projected/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-kube-api-access-wjwdw\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-cnibin\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185324    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-run\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185326    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-kubelet\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185348    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-systemd\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185369    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8da648a-bff4-4bba-8a02-637d3feed260-tmp\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185423    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-system-cni-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185392    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-modprobe-d\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185444    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-systemd\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-system-cni-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a443e5c-f716-48e6-a89e-8c31553f7131-host-slash\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185541    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-kubernetes\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185544    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a443e5c-f716-48e6-a89e-8c31553f7131-host-slash\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185475    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-run\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysctl-conf\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185595    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-daemon-config\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185632    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-kubelet-config\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-kubernetes\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185680    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-dbus\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.185786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185723    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysctl-conf\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185731    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-lib-modules\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8da648a-bff4-4bba-8a02-637d3feed260-etc-tuned\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185790    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzdb9\" (UniqueName: \"kubernetes.io/projected/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-kube-api-access-vzdb9\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185809    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-dbus\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185813    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-cni-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185835    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-lib-modules\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-os-release\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185874    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-os-release\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185684    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-kubelet-config\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-k8s-cni-cncf-io\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-cni-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185922    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-multus-certs\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185924    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-k8s-cni-cncf-io\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185972    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-multus-certs\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.186490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.185974    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-cni-binary-copy\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-sys\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-netns\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-conf-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186158    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-sys\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186171    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-daemon-config\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186184    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-hostroot\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-var-lib-kubelet\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186218    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-run-netns\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrz2r\" (UniqueName: \"kubernetes.io/projected/c8da648a-bff4-4bba-8a02-637d3feed260-kube-api-access-zrz2r\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-conf-dir\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-socket-dir-parent\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186259    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-hostroot\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186281    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-serviceca\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186297    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-var-lib-kubelet\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.187100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-cni-bin\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186321    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-multus-socket-dir-parent\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-etc-kubernetes\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186366    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a443e5c-f716-48e6-a89e-8c31553f7131-iptables-alerter-script\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186375    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-etc-kubernetes\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186401    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtqq\" (UniqueName: \"kubernetes.io/projected/0a443e5c-f716-48e6-a89e-8c31553f7131-kube-api-access-fxtqq\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186422    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-cni-bin\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186427    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysconfig\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysctl-d\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186474    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-host\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186499    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-host\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186529    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-cni-multus\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186553    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186665    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-host\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.186669    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:00.187541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186711    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysctl-d\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.188036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186720    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-host-var-lib-cni-multus\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.188036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186724    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-serviceca\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.188036 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.186758    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret podName:933fd8ef-d979-4fb3-a1ec-8b914e77aae4 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:00.686740335 +0000 UTC m=+2.077995514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret") pod "global-pull-secret-syncer-rhs8q" (UID: "933fd8ef-d979-4fb3-a1ec-8b914e77aae4") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:00.188036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186771    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-host\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.188036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186785    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8da648a-bff4-4bba-8a02-637d3feed260-etc-sysconfig\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.188036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.186998    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a443e5c-f716-48e6-a89e-8c31553f7131-iptables-alerter-script\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.188036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.187873    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8da648a-bff4-4bba-8a02-637d3feed260-tmp\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.188036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.187922    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8da648a-bff4-4bba-8a02-637d3feed260-etc-tuned\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.199613 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.199589    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxtqq\" (UniqueName: \"kubernetes.io/projected/0a443e5c-f716-48e6-a89e-8c31553f7131-kube-api-access-fxtqq\") pod \"iptables-alerter-mqvbx\" (UID: \"0a443e5c-f716-48e6-a89e-8c31553f7131\") " pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.201287 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.201264    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzdb9\" (UniqueName: \"kubernetes.io/projected/02c95ba1-0943-4f5f-83d8-37112fa3dd4e-kube-api-access-vzdb9\") pod \"node-ca-f9qht\" (UID: \"02c95ba1-0943-4f5f-83d8-37112fa3dd4e\") " pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.201437 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.201291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrz2r\" (UniqueName: \"kubernetes.io/projected/c8da648a-bff4-4bba-8a02-637d3feed260-kube-api-access-zrz2r\") pod \"tuned-89lmn\" (UID: \"c8da648a-bff4-4bba-8a02-637d3feed260\") " pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.202178 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.202156    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjwdw\" (UniqueName: \"kubernetes.io/projected/53f220b7-02ac-4a9a-b3b7-073cf6ac27a7-kube-api-access-wjwdw\") pod \"multus-fkvmr\" (UID: \"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7\") " pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.228714 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.228660    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004c5084a01cb59f72fdfadb659205a4.slice/crio-06c0723fee88e5fbad7f58c5794616f1bde667123b2935a33484fb827ebc9ddd WatchSource:0}: Error finding container 06c0723fee88e5fbad7f58c5794616f1bde667123b2935a33484fb827ebc9ddd: Status 404 returned error can't find the container with id 06c0723fee88e5fbad7f58c5794616f1bde667123b2935a33484fb827ebc9ddd
Jul 20 22:23:00.229115 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.229096    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc907d48106b2307f2766163a9d53737a.slice/crio-021c2e3e157b6b9d8288c879234de5207307d6233560897b451a39b7038a0a45 WatchSource:0}: Error finding container 021c2e3e157b6b9d8288c879234de5207307d6233560897b451a39b7038a0a45: Status 404 returned error can't find the container with id 021c2e3e157b6b9d8288c879234de5207307d6233560897b451a39b7038a0a45
Jul 20 22:23:00.233293 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.233277    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:23:00.303931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.303896    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:00.313078 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.313050    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73b29df_82d7_4184_b070_648cd7f9d3d1.slice/crio-4c7b7ebc5a86db20b81bec4d00ded6264b37ac6113c903d5a17a28d7f91fed60 WatchSource:0}: Error finding container 4c7b7ebc5a86db20b81bec4d00ded6264b37ac6113c903d5a17a28d7f91fed60: Status 404 returned error can't find the container with id 4c7b7ebc5a86db20b81bec4d00ded6264b37ac6113c903d5a17a28d7f91fed60
Jul 20 22:23:00.322262 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.322241    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:00.332170 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.332140    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67022b7a_0606_461d_8ddc_5b3582a485ad.slice/crio-7db2c69c5284c578beb144b2d0f8ea9fe8eb3ccfdcc6899303b4250bd11d728a WatchSource:0}: Error finding container 7db2c69c5284c578beb144b2d0f8ea9fe8eb3ccfdcc6899303b4250bd11d728a: Status 404 returned error can't find the container with id 7db2c69c5284c578beb144b2d0f8ea9fe8eb3ccfdcc6899303b4250bd11d728a
Jul 20 22:23:00.340777 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.340758    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78"
Jul 20 22:23:00.348124 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.348100    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd918307f_b267_491e_a555_cbeb00e1f099.slice/crio-776c788b5c63517e43cc368afb744a8fd44f4fbee6d5fb04248bc0b5d1c0c795 WatchSource:0}: Error finding container 776c788b5c63517e43cc368afb744a8fd44f4fbee6d5fb04248bc0b5d1c0c795: Status 404 returned error can't find the container with id 776c788b5c63517e43cc368afb744a8fd44f4fbee6d5fb04248bc0b5d1c0c795
Jul 20 22:23:00.352024 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.352004    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4trw"
Jul 20 22:23:00.359338 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.359317    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecf7578_ba19_449d_a011_59cc584d9f17.slice/crio-67537f606ec9cf5040fadfe29dbc8acb403969ff550e7b6eecb67ba566f13c04 WatchSource:0}: Error finding container 67537f606ec9cf5040fadfe29dbc8acb403969ff550e7b6eecb67ba566f13c04: Status 404 returned error can't find the container with id 67537f606ec9cf5040fadfe29dbc8acb403969ff550e7b6eecb67ba566f13c04
Jul 20 22:23:00.365584 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.365565    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4xlq8"
Jul 20 22:23:00.373561 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.373540    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504a25f5_9b0c_4111_b516_0c1345759490.slice/crio-be0849e0d576a6431cd93f52eeab3f808ccf9ad8e9ebae06b95d8b93dcfe2ebf WatchSource:0}: Error finding container be0849e0d576a6431cd93f52eeab3f808ccf9ad8e9ebae06b95d8b93dcfe2ebf: Status 404 returned error can't find the container with id be0849e0d576a6431cd93f52eeab3f808ccf9ad8e9ebae06b95d8b93dcfe2ebf
Jul 20 22:23:00.385297 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.385280    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mqvbx"
Jul 20 22:23:00.392728 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.392709    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a443e5c_f716_48e6_a89e_8c31553f7131.slice/crio-fac1209c547adff75634ba1270a368832a67c8e35ba3d257669b6d5fadba7685 WatchSource:0}: Error finding container fac1209c547adff75634ba1270a368832a67c8e35ba3d257669b6d5fadba7685: Status 404 returned error can't find the container with id fac1209c547adff75634ba1270a368832a67c8e35ba3d257669b6d5fadba7685
Jul 20 22:23:00.396620 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.396602    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89lmn"
Jul 20 22:23:00.404069 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.404046    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8da648a_bff4_4bba_8a02_637d3feed260.slice/crio-da5a2f62232ab08c28c33503e1d314e1804814008f4a8aeaabd27e629e813cf3 WatchSource:0}: Error finding container da5a2f62232ab08c28c33503e1d314e1804814008f4a8aeaabd27e629e813cf3: Status 404 returned error can't find the container with id da5a2f62232ab08c28c33503e1d314e1804814008f4a8aeaabd27e629e813cf3
Jul 20 22:23:00.433490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.433461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f9qht"
Jul 20 22:23:00.440168 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.440147    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fkvmr"
Jul 20 22:23:00.442485 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.442462    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c95ba1_0943_4f5f_83d8_37112fa3dd4e.slice/crio-d984623115409ea73a22d381e259cb43668a35c9260555e04949fa0d69e50613 WatchSource:0}: Error finding container d984623115409ea73a22d381e259cb43668a35c9260555e04949fa0d69e50613: Status 404 returned error can't find the container with id d984623115409ea73a22d381e259cb43668a35c9260555e04949fa0d69e50613
Jul 20 22:23:00.448049 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:00.448028    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f220b7_02ac_4a9a_b3b7_073cf6ac27a7.slice/crio-715de592ad136b678b0e6c79155af31401ce188e8e4f72265b0c4417e279027a WatchSource:0}: Error finding container 715de592ad136b678b0e6c79155af31401ce188e8e4f72265b0c4417e279027a: Status 404 returned error can't find the container with id 715de592ad136b678b0e6c79155af31401ce188e8e4f72265b0c4417e279027a
Jul 20 22:23:00.589559 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.589482    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:00.589722 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.589583    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:00.589722 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.589632    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs podName:6d7b2314-23d4-4538-973f-ec96e28a1b7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:01.58961956 +0000 UTC m=+2.980874734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs") pod "network-metrics-daemon-b7hjs" (UID: "6d7b2314-23d4-4538-973f-ec96e28a1b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:00.690216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.690174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:00.690371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:00.690243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:00.690371 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.690356    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:00.690496 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.690367    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:00.690496 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.690388    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:00.690496 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.690398    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lct2c for pod openshift-network-diagnostics/network-check-target-74244: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:00.690496 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.690414    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret podName:933fd8ef-d979-4fb3-a1ec-8b914e77aae4 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:01.690395915 +0000 UTC m=+3.081651109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret") pod "global-pull-secret-syncer-rhs8q" (UID: "933fd8ef-d979-4fb3-a1ec-8b914e77aae4") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:00.690496 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:00.690438    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c podName:aff9386a-9259-4ab3-875e-cf6c0fdeee7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:01.6904255 +0000 UTC m=+3.081680674 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lct2c" (UniqueName: "kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c") pod "network-check-target-74244" (UID: "aff9386a-9259-4ab3-875e-cf6c0fdeee7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:01.022442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.022280    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 22:18:00 +0000 UTC" deadline="2028-04-15 08:25:09.593278186 +0000 UTC"
Jul 20 22:23:01.022442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.022341    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15226h2m8.570941823s"
Jul 20 22:23:01.132537 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.132506    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:01.180039 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.179892    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f9qht" event={"ID":"02c95ba1-0943-4f5f-83d8-37112fa3dd4e","Type":"ContainerStarted","Data":"d984623115409ea73a22d381e259cb43668a35c9260555e04949fa0d69e50613"}
Jul 20 22:23:01.184937 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.184895    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqvbx" event={"ID":"0a443e5c-f716-48e6-a89e-8c31553f7131","Type":"ContainerStarted","Data":"fac1209c547adff75634ba1270a368832a67c8e35ba3d257669b6d5fadba7685"}
Jul 20 22:23:01.193366 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.193318    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerStarted","Data":"be0849e0d576a6431cd93f52eeab3f808ccf9ad8e9ebae06b95d8b93dcfe2ebf"}
Jul 20 22:23:01.197643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.197082    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:01.198321 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.198285    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4zbpd" event={"ID":"67022b7a-0606-461d-8ddc-5b3582a485ad","Type":"ContainerStarted","Data":"7db2c69c5284c578beb144b2d0f8ea9fe8eb3ccfdcc6899303b4250bd11d728a"}
Jul 20 22:23:01.202575 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.202462    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"4c7b7ebc5a86db20b81bec4d00ded6264b37ac6113c903d5a17a28d7f91fed60"}
Jul 20 22:23:01.205204 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.205128    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fkvmr" event={"ID":"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7","Type":"ContainerStarted","Data":"715de592ad136b678b0e6c79155af31401ce188e8e4f72265b0c4417e279027a"}
Jul 20 22:23:01.207773 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.207680    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89lmn" event={"ID":"c8da648a-bff4-4bba-8a02-637d3feed260","Type":"ContainerStarted","Data":"da5a2f62232ab08c28c33503e1d314e1804814008f4a8aeaabd27e629e813cf3"}
Jul 20 22:23:01.211476 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.211373    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4trw" event={"ID":"becf7578-ba19-449d-a011-59cc584d9f17","Type":"ContainerStarted","Data":"67537f606ec9cf5040fadfe29dbc8acb403969ff550e7b6eecb67ba566f13c04"}
Jul 20 22:23:01.237873 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.237783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78" event={"ID":"d918307f-b267-491e-a555-cbeb00e1f099","Type":"ContainerStarted","Data":"776c788b5c63517e43cc368afb744a8fd44f4fbee6d5fb04248bc0b5d1c0c795"}
Jul 20 22:23:01.262404 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.262370    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal" event={"ID":"004c5084a01cb59f72fdfadb659205a4","Type":"ContainerStarted","Data":"06c0723fee88e5fbad7f58c5794616f1bde667123b2935a33484fb827ebc9ddd"}
Jul 20 22:23:01.265959 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.265585    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal" event={"ID":"c907d48106b2307f2766163a9d53737a","Type":"ContainerStarted","Data":"021c2e3e157b6b9d8288c879234de5207307d6233560897b451a39b7038a0a45"}
Jul 20 22:23:01.600931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.600897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:01.601118 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:01.601050    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:01.601118 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:01.601113    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs podName:6d7b2314-23d4-4538-973f-ec96e28a1b7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:03.601094825 +0000 UTC m=+4.992350016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs") pod "network-metrics-daemon-b7hjs" (UID: "6d7b2314-23d4-4538-973f-ec96e28a1b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:01.703023 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.702125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:01.703023 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:01.702291    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:01.703023 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:01.702429    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:01.703023 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:01.702493    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret podName:933fd8ef-d979-4fb3-a1ec-8b914e77aae4 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:03.702474387 +0000 UTC m=+5.093729565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret") pod "global-pull-secret-syncer-rhs8q" (UID: "933fd8ef-d979-4fb3-a1ec-8b914e77aae4") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:01.703023 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:01.702917    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:01.703023 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:01.702939    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:01.703023 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:01.702952    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lct2c for pod openshift-network-diagnostics/network-check-target-74244: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:01.703023 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:01.702997    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c podName:aff9386a-9259-4ab3-875e-cf6c0fdeee7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:03.702982024 +0000 UTC m=+5.094237201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lct2c" (UniqueName: "kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c") pod "network-check-target-74244" (UID: "aff9386a-9259-4ab3-875e-cf6c0fdeee7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:02.022650 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:02.022517    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 22:18:00 +0000 UTC" deadline="2028-01-06 11:54:07.474040369 +0000 UTC"
Jul 20 22:23:02.022650 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:02.022561    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12829h31m5.451484946s"
Jul 20 22:23:02.163594 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:02.163564    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:02.163795 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:02.163731    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:02.164156 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:02.164133    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:02.164253 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:02.164234    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:02.164327 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:02.164296    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:02.164382 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:02.164369    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:02.540552 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:02.540520    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:23:03.617601 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:03.617503    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:03.618041 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:03.617724    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:03.618041 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:03.617808    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs podName:6d7b2314-23d4-4538-973f-ec96e28a1b7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:07.617777072 +0000 UTC m=+9.009032269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs") pod "network-metrics-daemon-b7hjs" (UID: "6d7b2314-23d4-4538-973f-ec96e28a1b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:03.718580 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:03.718543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:03.718766 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:03.718611    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:03.718766 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:03.718753    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:03.718881 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:03.718813    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret podName:933fd8ef-d979-4fb3-a1ec-8b914e77aae4 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:07.718794212 +0000 UTC m=+9.110049389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret") pod "global-pull-secret-syncer-rhs8q" (UID: "933fd8ef-d979-4fb3-a1ec-8b914e77aae4") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:03.719229 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:03.719205    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:03.719332 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:03.719232    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:03.719332 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:03.719245    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lct2c for pod openshift-network-diagnostics/network-check-target-74244: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:03.719332 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:03.719291    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c podName:aff9386a-9259-4ab3-875e-cf6c0fdeee7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:07.719276267 +0000 UTC m=+9.110531444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lct2c" (UniqueName: "kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c") pod "network-check-target-74244" (UID: "aff9386a-9259-4ab3-875e-cf6c0fdeee7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:04.163949 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:04.163916    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:04.164135 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:04.164053    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:04.164385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:04.164366    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:04.164484 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:04.164456    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:04.164541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:04.164495    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:04.164600 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:04.164543    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:06.164650 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:06.164083    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:06.164650 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:06.164217    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:06.164650 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:06.164456    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:06.164650 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:06.164566    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:06.164650 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:06.164628    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:06.165341 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:06.164716    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:07.652266 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:07.652225    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:07.652739 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:07.652413    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:07.652739 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:07.652505    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs podName:6d7b2314-23d4-4538-973f-ec96e28a1b7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:15.652481678 +0000 UTC m=+17.043736872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs") pod "network-metrics-daemon-b7hjs" (UID: "6d7b2314-23d4-4538-973f-ec96e28a1b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:07.753100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:07.753041    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:07.753265 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:07.753157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:07.753265 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:07.753192    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:07.753377 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:07.753267    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret podName:933fd8ef-d979-4fb3-a1ec-8b914e77aae4 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:15.753245871 +0000 UTC m=+17.144501065 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret") pod "global-pull-secret-syncer-rhs8q" (UID: "933fd8ef-d979-4fb3-a1ec-8b914e77aae4") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:07.753377 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:07.753311    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:07.753377 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:07.753334    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:07.753377 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:07.753348    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lct2c for pod openshift-network-diagnostics/network-check-target-74244: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:07.753524 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:07.753396    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c podName:aff9386a-9259-4ab3-875e-cf6c0fdeee7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:15.753379358 +0000 UTC m=+17.144634535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lct2c" (UniqueName: "kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c") pod "network-check-target-74244" (UID: "aff9386a-9259-4ab3-875e-cf6c0fdeee7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:08.163826 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:08.163792    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:08.164029 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:08.163842    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:08.164029 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:08.163843    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:08.164029 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:08.163949    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:08.164183 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:08.164045    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:08.164183 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:08.164125    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:10.163435 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:10.163345    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:10.163435 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:10.163384    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:10.163951 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:10.163506    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:10.163951 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:10.163597    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:10.163951 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:10.163687    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:10.163951 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:10.163787    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:12.163515 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:12.163438    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:12.163960 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:12.163438    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:12.163960 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:12.163558    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:12.163960 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:12.163653    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:12.163960 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:12.163441    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:12.163960 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:12.163779    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:14.163798 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:14.163765    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:14.164246 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:14.163767    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:14.164246 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:14.163915    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:14.164246 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:14.163766    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:14.164246 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:14.163974    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:14.164246 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:14.164053    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:15.716969 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:15.716932    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:15.717289 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:15.717039    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:15.717289 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:15.717090    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs podName:6d7b2314-23d4-4538-973f-ec96e28a1b7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:31.717075821 +0000 UTC m=+33.108330998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs") pod "network-metrics-daemon-b7hjs" (UID: "6d7b2314-23d4-4538-973f-ec96e28a1b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:15.818067 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:15.817986    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:15.818067 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:15.818049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:15.818236 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:15.818140    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:15.818236 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:15.818209    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret podName:933fd8ef-d979-4fb3-a1ec-8b914e77aae4 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:31.818189068 +0000 UTC m=+33.209444259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret") pod "global-pull-secret-syncer-rhs8q" (UID: "933fd8ef-d979-4fb3-a1ec-8b914e77aae4") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:15.818236 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:15.818147    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:15.818330 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:15.818243    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:15.818330 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:15.818252    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lct2c for pod openshift-network-diagnostics/network-check-target-74244: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:15.818330 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:15.818291    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c podName:aff9386a-9259-4ab3-875e-cf6c0fdeee7f nodeName:}" failed. No retries permitted until 2026-07-20 22:23:31.818280825 +0000 UTC m=+33.209535999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lct2c" (UniqueName: "kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c") pod "network-check-target-74244" (UID: "aff9386a-9259-4ab3-875e-cf6c0fdeee7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:16.163528 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:16.163441    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:16.163528 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:16.163476    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:16.163760 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:16.163440    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:16.163760 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:16.163575    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:16.163760 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:16.163638    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:16.163883 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:16.163749    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:18.164021 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:18.163824    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:18.164452 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:18.163849    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:18.164452 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:18.163891    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:18.164452 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:18.164116    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:18.164452 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:18.164224    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:18.164452 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:18.164327    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:20.164039 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:20.164008    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:20.164398 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:20.164071    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:20.164398 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:20.164096    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:20.164398 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:20.164181    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:20.164398 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:20.164260    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:20.164398 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:20.164351    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:21.306885 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.306427    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f9qht" event={"ID":"02c95ba1-0943-4f5f-83d8-37112fa3dd4e","Type":"ContainerStarted","Data":"418dbb0a39fd581ce4757bf431f0337e35893fce42d5d8468fe52b27897aec12"}
Jul 20 22:23:21.308318 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.308274    2572 generic.go:356] "Generic (PLEG): container finished" podID="504a25f5-9b0c-4111-b516-0c1345759490" containerID="ad59805902341f36b820f762e7c05a4bcc59014cb60fc79cb37209327077e62e" exitCode=0
Jul 20 22:23:21.308438 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.308372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerDied","Data":"ad59805902341f36b820f762e7c05a4bcc59014cb60fc79cb37209327077e62e"}
Jul 20 22:23:21.310606 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.310585    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4zbpd" event={"ID":"67022b7a-0606-461d-8ddc-5b3582a485ad","Type":"ContainerStarted","Data":"f6543df1ca60e30ae560d84e36b06eb6620dec659ba764f4b1850d1479d84383"}
Jul 20 22:23:21.314145 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.314118    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"0f10bad97a99c24f9568acf1b083b958f34fa45b5797d162fe80e9a0e9899e5b"}
Jul 20 22:23:21.314238 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.314213    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"7ad190389c63af449fd3699110be5e06efa8dc9ef965709f14b08d60079650be"}
Jul 20 22:23:21.314294 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.314261    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"3f37398bdb72b88b51a8e27060290b698cb224a08a2965ad61a2060447f4a83d"}
Jul 20 22:23:21.314340 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.314299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"43f7201349ad53dfcb0b5a830217d6282463a3e9eafbf45865a0b6bc7a4f2ed1"}
Jul 20 22:23:21.314395 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.314346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"81a89c6dfdeb06ebf19ac1d35415f67a8d8c11a0a70557497b515cf4b22bd044"}
Jul 20 22:23:21.314451 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.314419    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"ef2384dcb7897e8c7467241f09e395970079da159233e3cf023c048d2c1536a7"}
Jul 20 22:23:21.315710 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.315674    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fkvmr" event={"ID":"53f220b7-02ac-4a9a-b3b7-073cf6ac27a7","Type":"ContainerStarted","Data":"e9fcdfc6ced6ca4c15ba325c23cdf54dc90083f148e5124404fc56090497c1ef"}
Jul 20 22:23:21.317421 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.317396    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89lmn" event={"ID":"c8da648a-bff4-4bba-8a02-637d3feed260","Type":"ContainerStarted","Data":"7f33b8378fbc7333b9bf3daeca55c2807ed0be77ae57606eaa41b03e4d99b4af"}
Jul 20 22:23:21.318927 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.318849    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4trw" event={"ID":"becf7578-ba19-449d-a011-59cc584d9f17","Type":"ContainerStarted","Data":"a8e71a304c73077b8107927def392472e7a9c2e088503c8b472e793971e2fcad"}
Jul 20 22:23:21.320650 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.320626    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78" event={"ID":"d918307f-b267-491e-a555-cbeb00e1f099","Type":"ContainerStarted","Data":"4d4ed001bdebced7b82f8d2bb1e7e0cd5b92660b11e93fb59cabb964c310fe2c"}
Jul 20 22:23:21.322190 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.322162    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal" event={"ID":"004c5084a01cb59f72fdfadb659205a4","Type":"ContainerStarted","Data":"9aae03eaf3c982dc77fa336b15bb34683869e07d7d9b9de11f152024792fb7fc"}
Jul 20 22:23:21.322302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.322277    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:23:21.323669 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.323648    2572 generic.go:356] "Generic (PLEG): container finished" podID="c907d48106b2307f2766163a9d53737a" containerID="9db94e1cd93fab37a01fe4ebacb03cd247bb8f31d5ea6f0ef6c29a6531f733da" exitCode=0
Jul 20 22:23:21.323849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.323678    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal" event={"ID":"c907d48106b2307f2766163a9d53737a","Type":"ContainerDied","Data":"9db94e1cd93fab37a01fe4ebacb03cd247bb8f31d5ea6f0ef6c29a6531f733da"}
Jul 20 22:23:21.343318 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.343268    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f9qht" podStartSLOduration=2.636120913 podStartE2EDuration="22.34325357s" totalImagesPullingTime="19.707132657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:21.328941742 +0000 UTC m=+22.720196937" watchObservedRunningTime="2026-07-20 22:23:21.34325357 +0000 UTC m=+22.734508758"
Jul 20 22:23:21.343427 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.343319    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 22:23:21.343885 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.343865    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"]
Jul 20 22:23:21.349662 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.349631    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4zbpd" podStartSLOduration=2.531286001 podStartE2EDuration="22.349619573s" totalImagesPullingTime="19.818333572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:21.349449936 +0000 UTC m=+22.740705132" watchObservedRunningTime="2026-07-20 22:23:21.349619573 +0000 UTC m=+22.740874768"
Jul 20 22:23:21.410216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.410159    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fkvmr" podStartSLOduration=2.307307259 podStartE2EDuration="22.410139527s" totalImagesPullingTime="20.102832268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:21.409473231 +0000 UTC m=+22.800728427" watchObservedRunningTime="2026-07-20 22:23:21.410139527 +0000 UTC m=+22.801394724"
Jul 20 22:23:21.432166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.432123    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p4trw" podStartSLOduration=2.593351223 podStartE2EDuration="22.43210748s" totalImagesPullingTime="19.838756257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:21.431864624 +0000 UTC m=+22.823119803" watchObservedRunningTime="2026-07-20 22:23:21.43210748 +0000 UTC m=+22.823362676"
Jul 20 22:23:21.463245 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:21.461816    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-89lmn" podStartSLOduration=2.666418573 podStartE2EDuration="22.461797996s" totalImagesPullingTime="19.795379423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:21.461365471 +0000 UTC m=+22.852620668" watchObservedRunningTime="2026-07-20 22:23:21.461797996 +0000 UTC m=+22.853053193"
Jul 20 22:23:22.163561 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.163329    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:22.163844 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.163329    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:22.163844 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:22.163668    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:22.163844 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:22.163771    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:22.163844 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.163329    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:22.164050 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:22.163907    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:22.176007 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.175981    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 22:23:22.327483 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.327452    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78" event={"ID":"d918307f-b267-491e-a555-cbeb00e1f099","Type":"ContainerStarted","Data":"fa6b62e59609da6819cf5c98589bc63fd65c921bf191f0c89bde9b818c181b88"}
Jul 20 22:23:22.328811 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.328780    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mqvbx" event={"ID":"0a443e5c-f716-48e6-a89e-8c31553f7131","Type":"ContainerStarted","Data":"72020982e7c60f7dbe782aa5a8cee8a93e7392b225623de4b58ab82d273a35b9"}
Jul 20 22:23:22.329292 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.329275    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:23:22.339395 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.339381    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 22:23:22.339491 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:22.339432    2572 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-136-15.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal"
Jul 20 22:23:22.345004 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.344967    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-15.ec2.internal" podStartSLOduration=1.344955823 podStartE2EDuration="1.344955823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:22.344834503 +0000 UTC m=+23.736089709" watchObservedRunningTime="2026-07-20 22:23:22.344955823 +0000 UTC m=+23.736211019"
Jul 20 22:23:22.364869 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:22.364821    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mqvbx" podStartSLOduration=3.559353528 podStartE2EDuration="23.364809684s" totalImagesPullingTime="19.805456156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:22.364435232 +0000 UTC m=+23.755690428" watchObservedRunningTime="2026-07-20 22:23:22.364809684 +0000 UTC m=+23.756064892"
Jul 20 22:23:23.097161 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:23.096978    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T22:23:22.176001685Z","UUID":"0a596616-cdb4-4ef8-aca9-e42bdd07d997","Handler":null,"Name":"","Endpoint":""}
Jul 20 22:23:23.098637 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:23.098603    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 22:23:23.098782 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:23.098647    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 22:23:23.321360 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:23.321330    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:23.333330 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:23.333299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal" event={"ID":"c907d48106b2307f2766163a9d53737a","Type":"ContainerStarted","Data":"22d038e213aa0982194aac14d6d0305ec639d0591940ecc6f83e636cb422f4be"}
Jul 20 22:23:23.352226 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:23.352132    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-15.ec2.internal" podStartSLOduration=24.35211189 podStartE2EDuration="24.35211189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:23.351673753 +0000 UTC m=+24.742928960" watchObservedRunningTime="2026-07-20 22:23:23.35211189 +0000 UTC m=+24.743367087"
Jul 20 22:23:24.159616 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.159581    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:24.160254 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.160220    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:24.163363 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.163342    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:24.163457 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.163431    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:24.163509 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.163463    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:24.163509 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:24.163451    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:24.163626 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:24.163569    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:24.163688 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:24.163663    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:24.338044 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.338010    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78" event={"ID":"d918307f-b267-491e-a555-cbeb00e1f099","Type":"ContainerStarted","Data":"4f215d8ce31db9ebc0e1e2ae458947ed1e10e14eaec8a05f77d44bd2af3e21c2"}
Jul 20 22:23:24.341200 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.341175    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"452a2090c0da428c93eec5fb1b551cefd4fe99725357216ca6f4b27afba0c993"}
Jul 20 22:23:24.341926 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.341906    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4zbpd"
Jul 20 22:23:24.358994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.358951    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p2g78" podStartSLOduration=3.109784815 podStartE2EDuration="25.358937922s" totalImagesPullingTime="22.249153107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:24.358372095 +0000 UTC m=+25.749627310" watchObservedRunningTime="2026-07-20 22:23:24.358937922 +0000 UTC m=+25.750193145"
Jul 20 22:23:24.456731 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.456631    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:24.551490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:24.551445    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:26.163515 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:26.163316    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:26.164128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:26.163408    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:26.164128 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:26.163607    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:26.164128 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:26.163711    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:26.164128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:26.163414    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:26.164128 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:26.163816    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:26.347074 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:26.347048    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerStarted","Data":"e721cc27b83f8371028041ab7774ae05a3a7f410c775fec5fcc7031c77db6f55"}
Jul 20 22:23:26.351019 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:26.350993    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" event={"ID":"d73b29df-82d7-4184-b070-648cd7f9d3d1","Type":"ContainerStarted","Data":"0591a6225d593ceb25d66ee3dee4bd213dfed73a949c1f9224ea2a84d4a2c98a"}
Jul 20 22:23:26.351167 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:26.351149    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:26.394708 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:26.394622    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl" podStartSLOduration=7.220331858 podStartE2EDuration="27.394608863s" totalImagesPullingTime="20.174277005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:26.394139938 +0000 UTC m=+27.785395159" watchObservedRunningTime="2026-07-20 22:23:26.394608863 +0000 UTC m=+27.785864058"
Jul 20 22:23:27.354730 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:27.354680    2572 generic.go:356] "Generic (PLEG): container finished" podID="504a25f5-9b0c-4111-b516-0c1345759490" containerID="e721cc27b83f8371028041ab7774ae05a3a7f410c775fec5fcc7031c77db6f55" exitCode=0
Jul 20 22:23:27.355422 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:27.354725    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerDied","Data":"e721cc27b83f8371028041ab7774ae05a3a7f410c775fec5fcc7031c77db6f55"}
Jul 20 22:23:27.355422 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:27.355330    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:27.355422 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:27.355392    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:27.370844 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:27.370823    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:27.370939 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:27.370925    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:28.058432 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.058202    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-74244"]
Jul 20 22:23:28.058611 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.058490    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:28.058611 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:28.058596    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:28.058751 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.058661    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rhs8q"]
Jul 20 22:23:28.058803 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.058766    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:28.058850 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:28.058836    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:28.082077 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.082046    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7hjs"]
Jul 20 22:23:28.082253 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.082230    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:28.082383 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:28.082367    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:28.208758 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.208722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:28.317946 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.317862    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:28.379920 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.379895    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:28.859231 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.859205    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:28.954826 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:28.954793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:29.305065 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:29.305025    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:29.361203 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:29.361166    2572 generic.go:356] "Generic (PLEG): container finished" podID="504a25f5-9b0c-4111-b516-0c1345759490" containerID="16dc8e856196daf6637f50a2135f379fc83ecd1f57444e54bb0a26a857a571d8" exitCode=0
Jul 20 22:23:29.361350 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:29.361224    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerDied","Data":"16dc8e856196daf6637f50a2135f379fc83ecd1f57444e54bb0a26a857a571d8"}
Jul 20 22:23:29.392389 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:29.392343    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:30.164139 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:30.164105    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:30.164286 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:30.164205    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:30.164286 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:30.164209    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:30.164286 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:30.164248    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:30.164385 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:30.164326    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:30.164419 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:30.164386    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:30.365567 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:30.365542    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerStarted","Data":"6083b098436e18856099f3a22a27b487416f0d2bbdc25edba4db5ca33285f473"}
Jul 20 22:23:31.369584 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:31.369551    2572 generic.go:356] "Generic (PLEG): container finished" podID="504a25f5-9b0c-4111-b516-0c1345759490" containerID="6083b098436e18856099f3a22a27b487416f0d2bbdc25edba4db5ca33285f473" exitCode=0
Jul 20 22:23:31.369977 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:31.369603    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerDied","Data":"6083b098436e18856099f3a22a27b487416f0d2bbdc25edba4db5ca33285f473"}
Jul 20 22:23:31.741838 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:31.741804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:31.742005 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:31.741906    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:31.742005 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:31.741958    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs podName:6d7b2314-23d4-4538-973f-ec96e28a1b7f nodeName:}" failed. No retries permitted until 2026-07-20 22:24:03.741943111 +0000 UTC m=+65.133198285 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs") pod "network-metrics-daemon-b7hjs" (UID: "6d7b2314-23d4-4538-973f-ec96e28a1b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:31.842347 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:31.842313    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:31.842535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:31.842407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:31.842535 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:31.842477    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:31.842535 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:31.842515    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:31.842718 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:31.842543    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret podName:933fd8ef-d979-4fb3-a1ec-8b914e77aae4 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:03.842524373 +0000 UTC m=+65.233779563 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret") pod "global-pull-secret-syncer-rhs8q" (UID: "933fd8ef-d979-4fb3-a1ec-8b914e77aae4") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:31.842718 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:31.842535    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:31.842718 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:31.842560    2572 projected.go:196] Error preparing data for projected volume kube-api-access-lct2c for pod openshift-network-diagnostics/network-check-target-74244: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:31.842718 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:31.842601    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c podName:aff9386a-9259-4ab3-875e-cf6c0fdeee7f nodeName:}" failed. No retries permitted until 2026-07-20 22:24:03.842586309 +0000 UTC m=+65.233841482 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lct2c" (UniqueName: "kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c") pod "network-check-target-74244" (UID: "aff9386a-9259-4ab3-875e-cf6c0fdeee7f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:32.163442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:32.163412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:32.163628 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:32.163412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:32.163628 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:32.163549    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rhs8q" podUID="933fd8ef-d979-4fb3-a1ec-8b914e77aae4"
Jul 20 22:23:32.163765 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:32.163668    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-74244" podUID="aff9386a-9259-4ab3-875e-cf6c0fdeee7f"
Jul 20 22:23:32.163765 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:32.163412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:32.163880 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:32.163800    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b7hjs" podUID="6d7b2314-23d4-4538-973f-ec96e28a1b7f"
Jul 20 22:23:32.709461 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:32.709282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:32.799408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:32.799367    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:33.421448 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.421419    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-15.ec2.internal" event="NodeReady"
Jul 20 22:23:33.421634 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.421561    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 22:23:33.474633 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.474602    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r9tzs"]
Jul 20 22:23:33.476504 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.476482    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.477370 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.477345    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pvpdm"]
Jul 20 22:23:33.479012 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.478991    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvpdm"
Jul 20 22:23:33.479293 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.479157    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 22:23:33.480020 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.479787    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 22:23:33.480020 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.479790    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4x2c5\""
Jul 20 22:23:33.482050 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.482000    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 22:23:33.482793 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.482772    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 22:23:33.482886 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.482813    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 22:23:33.482886 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.482864    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-679fm\""
Jul 20 22:23:33.492905 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.492885    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvpdm"]
Jul 20 22:23:33.496645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.496628    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r9tzs"]
Jul 20 22:23:33.555244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.555209    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgjj\" (UniqueName: \"kubernetes.io/projected/6a7cd14e-70d1-444e-a33a-c78bceda7799-kube-api-access-4sgjj\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.555420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.555265    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a7cd14e-70d1-444e-a33a-c78bceda7799-tmp-dir\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.555420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.555294    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.555420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.555344    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a7cd14e-70d1-444e-a33a-c78bceda7799-config-volume\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.656243 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.656212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgjj\" (UniqueName: \"kubernetes.io/projected/6a7cd14e-70d1-444e-a33a-c78bceda7799-kube-api-access-4sgjj\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.656419 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.656254    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5g46\" (UniqueName: \"kubernetes.io/projected/fae22371-021b-4515-a7f1-ed314a9c5558-kube-api-access-w5g46\") pod \"ingress-canary-pvpdm\" (UID: \"fae22371-021b-4515-a7f1-ed314a9c5558\") " pod="openshift-ingress-canary/ingress-canary-pvpdm"
Jul 20 22:23:33.656419 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.656306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a7cd14e-70d1-444e-a33a-c78bceda7799-tmp-dir\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.656533 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.656499    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.656592 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.656576    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a7cd14e-70d1-444e-a33a-c78bceda7799-config-volume\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.656632 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:33.656591    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:33.656632 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.656610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fae22371-021b-4515-a7f1-ed314a9c5558-cert\") pod \"ingress-canary-pvpdm\" (UID: \"fae22371-021b-4515-a7f1-ed314a9c5558\") " pod="openshift-ingress-canary/ingress-canary-pvpdm"
Jul 20 22:23:33.656689 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:33.656651    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls podName:6a7cd14e-70d1-444e-a33a-c78bceda7799 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:34.156629159 +0000 UTC m=+35.547884345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls") pod "dns-default-r9tzs" (UID: "6a7cd14e-70d1-444e-a33a-c78bceda7799") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:33.656769 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.656719    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a7cd14e-70d1-444e-a33a-c78bceda7799-tmp-dir\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.657178 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.657159    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a7cd14e-70d1-444e-a33a-c78bceda7799-config-volume\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.668488 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.668467    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgjj\" (UniqueName: \"kubernetes.io/projected/6a7cd14e-70d1-444e-a33a-c78bceda7799-kube-api-access-4sgjj\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:33.757143 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.757054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5g46\" (UniqueName: \"kubernetes.io/projected/fae22371-021b-4515-a7f1-ed314a9c5558-kube-api-access-w5g46\") pod \"ingress-canary-pvpdm\" (UID: \"fae22371-021b-4515-a7f1-ed314a9c5558\") " pod="openshift-ingress-canary/ingress-canary-pvpdm"
Jul 20 22:23:33.757522 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.757149    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fae22371-021b-4515-a7f1-ed314a9c5558-cert\") pod \"ingress-canary-pvpdm\" (UID: \"fae22371-021b-4515-a7f1-ed314a9c5558\") " pod="openshift-ingress-canary/ingress-canary-pvpdm"
Jul 20 22:23:33.759772 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.759748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fae22371-021b-4515-a7f1-ed314a9c5558-cert\") pod \"ingress-canary-pvpdm\" (UID: \"fae22371-021b-4515-a7f1-ed314a9c5558\") " pod="openshift-ingress-canary/ingress-canary-pvpdm"
Jul 20 22:23:33.769859 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.769833    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5g46\" (UniqueName: \"kubernetes.io/projected/fae22371-021b-4515-a7f1-ed314a9c5558-kube-api-access-w5g46\") pod \"ingress-canary-pvpdm\" (UID: \"fae22371-021b-4515-a7f1-ed314a9c5558\") " pod="openshift-ingress-canary/ingress-canary-pvpdm"
Jul 20 22:23:33.795734 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.795704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pvpdm"
Jul 20 22:23:33.941352 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:33.941314    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pvpdm"]
Jul 20 22:23:34.161580 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.161543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:34.161768 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:34.161708    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:34.161825 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:34.161775    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls podName:6a7cd14e-70d1-444e-a33a-c78bceda7799 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:35.16175681 +0000 UTC m=+36.553011997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls") pod "dns-default-r9tzs" (UID: "6a7cd14e-70d1-444e-a33a-c78bceda7799") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:34.163627 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.163600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:23:34.163763 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.163719    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:23:34.163827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.163809    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:23:34.166139 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.165924    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sk5f6\""
Jul 20 22:23:34.166139 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.165973    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 22:23:34.166945 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.166761    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 22:23:34.166945 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.166777    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-br7rv\""
Jul 20 22:23:34.166945 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.166775    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 22:23:34.167506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.167486    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 22:23:34.364515 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.364478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:34.450939 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.450861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:34.885313 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.885276    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pjwz6"]
Jul 20 22:23:34.887825 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.887805    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:34.891807 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.890254    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 22:23:34.891807 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.891303    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 22:23:34.891807 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.891457    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 22:23:34.891807 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.891553    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k67gj\""
Jul 20 22:23:34.891807 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.891736    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 22:23:34.900033 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.900015    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pjwz6"]
Jul 20 22:23:34.944527 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:34.944483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:35.024230 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.024194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:35.068985 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.068947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec578931-06be-4194-abef-b6adaf903b2c-data-volume\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.069123 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.068996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9rgx\" (UniqueName: \"kubernetes.io/projected/ec578931-06be-4194-abef-b6adaf903b2c-kube-api-access-v9rgx\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.069123 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.069102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec578931-06be-4194-abef-b6adaf903b2c-crio-socket\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.069208 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.069132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.069208 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.069183    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.118239 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.118203    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:35.169684 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.169609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec578931-06be-4194-abef-b6adaf903b2c-crio-socket\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.169684 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.169652    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.169684 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.169677    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.169756    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec578931-06be-4194-abef-b6adaf903b2c-data-volume\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.169783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9rgx\" (UniqueName: \"kubernetes.io/projected/ec578931-06be-4194-abef-b6adaf903b2c-kube-api-access-v9rgx\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.169798    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.169810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.169836    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.169862    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls podName:ec578931-06be-4194-abef-b6adaf903b2c nodeName:}" failed. No retries permitted until 2026-07-20 22:23:35.669843029 +0000 UTC m=+37.061098221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pjwz6" (UID: "ec578931-06be-4194-abef-b6adaf903b2c") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.169895    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.169905    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm podName:ec578931-06be-4194-abef-b6adaf903b2c nodeName:}" failed. No retries permitted until 2026-07-20 22:23:35.669885764 +0000 UTC m=+37.061140944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pjwz6" (UID: "ec578931-06be-4194-abef-b6adaf903b2c") : configmap "kube-rbac-proxy" not found
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.169914    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec578931-06be-4194-abef-b6adaf903b2c-crio-socket\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.169987 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.169927    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls podName:6a7cd14e-70d1-444e-a33a-c78bceda7799 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:37.169916756 +0000 UTC m=+38.561171930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls") pod "dns-default-r9tzs" (UID: "6a7cd14e-70d1-444e-a33a-c78bceda7799") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:35.170389 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.170146    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec578931-06be-4194-abef-b6adaf903b2c-data-volume\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.178508 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.178480    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9rgx\" (UniqueName: \"kubernetes.io/projected/ec578931-06be-4194-abef-b6adaf903b2c-kube-api-access-v9rgx\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.218921 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.218888    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:35.406455 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:35.406419    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae22371_021b_4515_a7f1_ed314a9c5558.slice/crio-f60eaff468467e3bcf0d2eabcdf76607bae71943b3073ff0c59ad8302afe3f68 WatchSource:0}: Error finding container f60eaff468467e3bcf0d2eabcdf76607bae71943b3073ff0c59ad8302afe3f68: Status 404 returned error can't find the container with id f60eaff468467e3bcf0d2eabcdf76607bae71943b3073ff0c59ad8302afe3f68
Jul 20 22:23:35.433028 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.432962    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:35.529166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.529005    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:35.661977 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.661949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:35.674153 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.674130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.674240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.674166    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:35.674285 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.674242    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 22:23:35.674326 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.674287    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm podName:ec578931-06be-4194-abef-b6adaf903b2c nodeName:}" failed. No retries permitted until 2026-07-20 22:23:36.674273726 +0000 UTC m=+38.065528900 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pjwz6" (UID: "ec578931-06be-4194-abef-b6adaf903b2c") : configmap "kube-rbac-proxy" not found
Jul 20 22:23:35.674373 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.674336    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:35.674408 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:35.674382    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls podName:ec578931-06be-4194-abef-b6adaf903b2c nodeName:}" failed. No retries permitted until 2026-07-20 22:23:36.674370586 +0000 UTC m=+38.065625760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pjwz6" (UID: "ec578931-06be-4194-abef-b6adaf903b2c") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:35.762684 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:35.762576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:36.058199 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.058167    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9"]
Jul 20 22:23:36.059989 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.059970    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9"
Jul 20 22:23:36.062611 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.062585    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 20 22:23:36.063472 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.063452    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8bppr\""
Jul 20 22:23:36.063812 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.063790    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 20 22:23:36.073916 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.073888    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9"]
Jul 20 22:23:36.120090 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.120048    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:36.178671 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.178633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8mc7\" (UniqueName: \"kubernetes.io/projected/e68cbda9-fbc3-4c1f-895e-0abbf183b6d1-kube-api-access-f8mc7\") pod \"migrator-7cc9c7ffd7-mmpd9\" (UID: \"e68cbda9-fbc3-4c1f-895e-0abbf183b6d1\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9"
Jul 20 22:23:36.193571 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.193533    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:36.280043 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.280009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8mc7\" (UniqueName: \"kubernetes.io/projected/e68cbda9-fbc3-4c1f-895e-0abbf183b6d1-kube-api-access-f8mc7\") pod \"migrator-7cc9c7ffd7-mmpd9\" (UID: \"e68cbda9-fbc3-4c1f-895e-0abbf183b6d1\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9"
Jul 20 22:23:36.290528 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.290499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8mc7\" (UniqueName: \"kubernetes.io/projected/e68cbda9-fbc3-4c1f-895e-0abbf183b6d1-kube-api-access-f8mc7\") pod \"migrator-7cc9c7ffd7-mmpd9\" (UID: \"e68cbda9-fbc3-4c1f-895e-0abbf183b6d1\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9"
Jul 20 22:23:36.371622 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.371510    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9"
Jul 20 22:23:36.386107 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.386001    2572 generic.go:356] "Generic (PLEG): container finished" podID="504a25f5-9b0c-4111-b516-0c1345759490" containerID="8e6cccc9936811ce16c3b5d5239176927cd561e22035e9c7261e8f0b71f72a7d" exitCode=0
Jul 20 22:23:36.386201 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.386095    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerDied","Data":"8e6cccc9936811ce16c3b5d5239176927cd561e22035e9c7261e8f0b71f72a7d"}
Jul 20 22:23:36.388363 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.388315    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvpdm" event={"ID":"fae22371-021b-4515-a7f1-ed314a9c5558","Type":"ContainerStarted","Data":"f60eaff468467e3bcf0d2eabcdf76607bae71943b3073ff0c59ad8302afe3f68"}
Jul 20 22:23:36.524822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.524797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9"]
Jul 20 22:23:36.530219 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:36.529212    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68cbda9_fbc3_4c1f_895e_0abbf183b6d1.slice/crio-71fc314f2532369cc1bf0820c608a702e07a17bb71d368d4a7529d683cb7c701 WatchSource:0}: Error finding container 71fc314f2532369cc1bf0820c608a702e07a17bb71d368d4a7529d683cb7c701: Status 404 returned error can't find the container with id 71fc314f2532369cc1bf0820c608a702e07a17bb71d368d4a7529d683cb7c701
Jul 20 22:23:36.682350 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.682270    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:36.682350 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:36.682321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:36.682566 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:36.682443    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:36.682566 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:36.682462    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 22:23:36.682566 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:36.682524    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls podName:ec578931-06be-4194-abef-b6adaf903b2c nodeName:}" failed. No retries permitted until 2026-07-20 22:23:38.68250351 +0000 UTC m=+40.073758695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pjwz6" (UID: "ec578931-06be-4194-abef-b6adaf903b2c") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:36.682566 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:36.682546    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm podName:ec578931-06be-4194-abef-b6adaf903b2c nodeName:}" failed. No retries permitted until 2026-07-20 22:23:38.682536111 +0000 UTC m=+40.073791324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pjwz6" (UID: "ec578931-06be-4194-abef-b6adaf903b2c") : configmap "kube-rbac-proxy" not found
Jul 20 22:23:37.086924 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.086895    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4trw_becf7578-ba19-449d-a011-59cc584d9f17/dns-node-resolver/0.log"
Jul 20 22:23:37.185682 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.185641    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:37.185838 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:37.185812    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:37.185899 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:37.185890    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls podName:6a7cd14e-70d1-444e-a33a-c78bceda7799 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:41.18586723 +0000 UTC m=+42.577122428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls") pod "dns-default-r9tzs" (UID: "6a7cd14e-70d1-444e-a33a-c78bceda7799") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:37.307236 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.307203    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:37.375064 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.374966    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:37.394185 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.394154    2572 generic.go:356] "Generic (PLEG): container finished" podID="504a25f5-9b0c-4111-b516-0c1345759490" containerID="b287856a94ed9f7ff652c43aa0c6a7ec9a0a62d83581e3edcfe09738307a4116" exitCode=0
Jul 20 22:23:37.394352 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.394228    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerDied","Data":"b287856a94ed9f7ff652c43aa0c6a7ec9a0a62d83581e3edcfe09738307a4116"}
Jul 20 22:23:37.395969 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.395941    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9" event={"ID":"e68cbda9-fbc3-4c1f-895e-0abbf183b6d1","Type":"ContainerStarted","Data":"71fc314f2532369cc1bf0820c608a702e07a17bb71d368d4a7529d683cb7c701"}
Jul 20 22:23:37.688006 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.687939    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f9qht_02c95ba1-0943-4f5f-83d8-37112fa3dd4e/node-ca/0.log"
Jul 20 22:23:37.756617 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.756580    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:37.840468 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:37.840438    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:38.574372 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:38.574345    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:38.697818 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:38.697787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:38.697937 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:38.697841    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:38.697973 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:38.697930    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:38.698009 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:38.697993    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls podName:ec578931-06be-4194-abef-b6adaf903b2c nodeName:}" failed. No retries permitted until 2026-07-20 22:23:42.697976734 +0000 UTC m=+44.089231922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pjwz6" (UID: "ec578931-06be-4194-abef-b6adaf903b2c") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:38.698505 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:38.698484    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec578931-06be-4194-abef-b6adaf903b2c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:38.741674 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:38.741606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:39.401113 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:39.401074    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pvpdm" event={"ID":"fae22371-021b-4515-a7f1-ed314a9c5558","Type":"ContainerStarted","Data":"697aa723e729df84155d5a1b59a394ffb449e420ca5c87d8f340c343620a7d7b"}
Jul 20 22:23:39.402797 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:39.402756    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9" event={"ID":"e68cbda9-fbc3-4c1f-895e-0abbf183b6d1","Type":"ContainerStarted","Data":"44d86a9f423472b7d9ad9d0a998c0ced9e8c5ac79c3591682c50e278fc041a99"}
Jul 20 22:23:39.402908 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:39.402819    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9" event={"ID":"e68cbda9-fbc3-4c1f-895e-0abbf183b6d1","Type":"ContainerStarted","Data":"34854183039e042d0a0a9ebfce75965009529b73c4c6c9ac066d74983b5c6642"}
Jul 20 22:23:39.408759 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:39.408736    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" event={"ID":"504a25f5-9b0c-4111-b516-0c1345759490","Type":"ContainerStarted","Data":"39298bb3e9266f3da4b4bc004db8795e5b89055b50aaa2364441a39122d00f85"}
Jul 20 22:23:39.422848 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:39.422805    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pvpdm" podStartSLOduration=3.298892276 podStartE2EDuration="6.422792208s" totalImagesPullingTime="3.123899932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:39.422063177 +0000 UTC m=+40.813318373" watchObservedRunningTime="2026-07-20 22:23:39.422792208 +0000 UTC m=+40.814047436"
Jul 20 22:23:39.446258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:39.446214    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4xlq8" podStartSLOduration=9.910343801 podStartE2EDuration="40.446201032s" totalImagesPullingTime="30.535857231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:39.445344983 +0000 UTC m=+40.836600190" watchObservedRunningTime="2026-07-20 22:23:39.446201032 +0000 UTC m=+40.837456229"
Jul 20 22:23:39.462596 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:39.462555    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mmpd9" podStartSLOduration=1.4605820569999999 podStartE2EDuration="3.462542072s" totalImagesPullingTime="2.001960015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:39.462002206 +0000 UTC m=+40.853257402" watchObservedRunningTime="2026-07-20 22:23:39.462542072 +0000 UTC m=+40.853797269"
Jul 20 22:23:40.728258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:40.728222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:40.856168 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:40.856128    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:40.938139 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:40.938110    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:41.092533 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:41.092505    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:41.216412 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:41.216383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:41.216559 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:41.216525    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:41.216610 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:41.216600    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls podName:6a7cd14e-70d1-444e-a33a-c78bceda7799 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:49.216583579 +0000 UTC m=+50.607838753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls") pod "dns-default-r9tzs" (UID: "6a7cd14e-70d1-444e-a33a-c78bceda7799") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:41.260550 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:41.260519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:41.454950 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:41.454857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:41.671095 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:41.671062    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:42.440221 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:42.440186    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:42.727448 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:42.727363    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:42.727598 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:42.727477    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:42.727598 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:23:42.727543    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls podName:ec578931-06be-4194-abef-b6adaf903b2c nodeName:}" failed. No retries permitted until 2026-07-20 22:23:50.727528164 +0000 UTC m=+52.118783338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pjwz6" (UID: "ec578931-06be-4194-abef-b6adaf903b2c") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:42.813470 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:42.813439    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:43.016529 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:43.016444    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:43.231802 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:43.231770    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:43.417979 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:43.417943    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:44.345515 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:44.345480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:44.445451 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:44.445413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:44.524745 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:44.524704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:44.816643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:44.816610    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:45.020677 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:45.020648    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:45.213416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:45.213331    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:45.424384 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:45.424351    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:46.422897 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:46.422854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:46.523359 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:46.523328    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:46.624804 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:46.624773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:46.688994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:46.688919    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:46.811470 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:46.811442    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:47.018436 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:47.018351    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:47.289480 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:47.289402    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:47.696713 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:47.696674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:47.765335 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:47.765301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:47.844224 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:47.844189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:48.224955 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:48.224923    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:48.621063 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:48.621035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:49.016498 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:49.016410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:49.274032 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:49.273940    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:49.277272 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:49.277247    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a7cd14e-70d1-444e-a33a-c78bceda7799-metrics-tls\") pod \"dns-default-r9tzs\" (UID: \"6a7cd14e-70d1-444e-a33a-c78bceda7799\") " pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:49.389292 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:49.389256    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:49.418851 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:49.418824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:49.525211 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:49.525141    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r9tzs"]
Jul 20 22:23:49.527907 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:49.527878    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7cd14e_70d1_444e_a33a_c78bceda7799.slice/crio-d61b396fbcb49a376d77df3ec08f6de60c4717051c8de4e4010fcff5bc9e2955 WatchSource:0}: Error finding container d61b396fbcb49a376d77df3ec08f6de60c4717051c8de4e4010fcff5bc9e2955: Status 404 returned error can't find the container with id d61b396fbcb49a376d77df3ec08f6de60c4717051c8de4e4010fcff5bc9e2955
Jul 20 22:23:49.621186 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:49.621150    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:50.025396 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:50.025361    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:50.426945 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:50.426907    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:50.434940 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:50.434906    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9tzs" event={"ID":"6a7cd14e-70d1-444e-a33a-c78bceda7799","Type":"ContainerStarted","Data":"d61b396fbcb49a376d77df3ec08f6de60c4717051c8de4e4010fcff5bc9e2955"}
Jul 20 22:23:50.784829 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:50.784760    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:50.786958 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:50.786933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec578931-06be-4194-abef-b6adaf903b2c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pjwz6\" (UID: \"ec578931-06be-4194-abef-b6adaf903b2c\") " pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:50.800038 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:50.800012    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pjwz6"
Jul 20 22:23:50.824127 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:50.824097    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:50.944527 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:50.944498    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pjwz6"]
Jul 20 22:23:50.948063 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:23:50.948035    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec578931_06be_4194_abef_b6adaf903b2c.slice/crio-9e657b3e851d9f3609cb803616e39c47f73dfeb76a29420b23fdc32d24a390ff WatchSource:0}: Error finding container 9e657b3e851d9f3609cb803616e39c47f73dfeb76a29420b23fdc32d24a390ff: Status 404 returned error can't find the container with id 9e657b3e851d9f3609cb803616e39c47f73dfeb76a29420b23fdc32d24a390ff
Jul 20 22:23:51.018958 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:51.018907    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:51.220524 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:51.220446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:51.414176 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:51.414140    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:51.439251 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:51.439218    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pjwz6" event={"ID":"ec578931-06be-4194-abef-b6adaf903b2c","Type":"ContainerStarted","Data":"9e657b3e851d9f3609cb803616e39c47f73dfeb76a29420b23fdc32d24a390ff"}
Jul 20 22:23:52.444257 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:52.444220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9tzs" event={"ID":"6a7cd14e-70d1-444e-a33a-c78bceda7799","Type":"ContainerStarted","Data":"d9f9db54e3268210ad1f8a53d2b1fdd40ed000129c31b03bd3bc605bbe92e2f3"}
Jul 20 22:23:52.444718 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:52.444275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r9tzs" event={"ID":"6a7cd14e-70d1-444e-a33a-c78bceda7799","Type":"ContainerStarted","Data":"a79dcb3f796babf24caa2f6ba80aef60e55e3c3228adf8e18cd45c24738f61bb"}
Jul 20 22:23:52.444718 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:52.444435    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:23:52.466100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:52.466012    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r9tzs" podStartSLOduration=17.050528899 podStartE2EDuration="19.465995447s" totalImagesPullingTime="2.415466548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:52.464678089 +0000 UTC m=+53.855933320" watchObservedRunningTime="2026-07-20 22:23:52.465995447 +0000 UTC m=+53.857250643"
Jul 20 22:23:57.440070 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.440022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:57.460544 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.460512    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pjwz6" event={"ID":"ec578931-06be-4194-abef-b6adaf903b2c","Type":"ContainerStarted","Data":"fd5e08ea39a066d0b406fb1e2d74ee9eafa535c06f265eeec33df9a38bf7e069"}
Jul 20 22:23:57.544340 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.544302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:57.816784 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.816751    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:57.956151 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.956116    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"]
Jul 20 22:23:57.960167 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.960142    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"]
Jul 20 22:23:57.960319 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.960276    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:57.962054 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.962033    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:57.963304 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.963285    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 22:23:57.963417 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.963341    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 22:23:57.963417 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.963343    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 22:23:57.964976 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.964934    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 20 22:23:57.965084 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.964994    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 20 22:23:57.967634 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.967583    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 20 22:23:57.967763 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.967656    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 20 22:23:57.968135 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.968118    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 22:23:57.983546 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.983516    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"]
Jul 20 22:23:57.984408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:57.984384    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"]
Jul 20 22:23:58.033652 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.033849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033674    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-tmp\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.033849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033735    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-klusterlet-config\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.033849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033772    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.033849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mctcf\" (UniqueName: \"kubernetes.io/projected/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-kube-api-access-mctcf\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.033849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-ca\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.034054 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf89b3b8-bba0-4bc0-bf1c-42253907a429-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.034054 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033961    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-hub\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.034054 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.033991    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f65l4\" (UniqueName: \"kubernetes.io/projected/bf89b3b8-bba0-4bc0-bf1c-42253907a429-kube-api-access-f65l4\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.135133 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-hub\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.135133 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135095    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f65l4\" (UniqueName: \"kubernetes.io/projected/bf89b3b8-bba0-4bc0-bf1c-42253907a429-kube-api-access-f65l4\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.135403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.135403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-tmp\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.135403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-klusterlet-config\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.135403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.135403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135399    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mctcf\" (UniqueName: \"kubernetes.io/projected/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-kube-api-access-mctcf\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.135641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-ca\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.135641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135552    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf89b3b8-bba0-4bc0-bf1c-42253907a429-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.135786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.135648    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-tmp\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.136438 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.136408    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf89b3b8-bba0-4bc0-bf1c-42253907a429-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.138301 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.138253    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-hub\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.138493 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.138471    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-ca\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.138620 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.138595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.138709 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.138624    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-klusterlet-config\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.138786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.138756    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bf89b3b8-bba0-4bc0-bf1c-42253907a429-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.143303 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.143267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:58.150089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.150068    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mctcf\" (UniqueName: \"kubernetes.io/projected/07a77fa1-fdb4-4af4-99d4-d46df3c3161d-kube-api-access-mctcf\") pod \"klusterlet-addon-workmgr-58865588f4-hg86l\" (UID: \"07a77fa1-fdb4-4af4-99d4-d46df3c3161d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.151573 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.151555    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f65l4\" (UniqueName: \"kubernetes.io/projected/bf89b3b8-bba0-4bc0-bf1c-42253907a429-kube-api-access-f65l4\") pod \"cluster-proxy-proxy-agent-5479f497cf-k9bv4\" (UID: \"bf89b3b8-bba0-4bc0-bf1c-42253907a429\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.272686 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.272647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:23:58.277748 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.277703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:58.286090 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.286062    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"
Jul 20 22:23:58.395609 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.395520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:58.595579 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.595541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:58.692320 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.692218    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:58.797156 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:58.797120    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:59.108796 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:59.108764    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:59.296841 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:59.296812    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:59.373982 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:59.373912    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bszzl"
Jul 20 22:23:59.517297 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:59.517247    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:59.932056 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:59.932007    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:23:59.997339 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:23:59.997293    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:00.358510 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.358205    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"]
Jul 20 22:24:00.364077 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.363985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:00.364883 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:24:00.364858    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a77fa1_fdb4_4af4_99d4_d46df3c3161d.slice/crio-d8f296365a21d0ba4b57412325cdb85a70bfd241b60e16fe785966b5d81464d2 WatchSource:0}: Error finding container d8f296365a21d0ba4b57412325cdb85a70bfd241b60e16fe785966b5d81464d2: Status 404 returned error can't find the container with id d8f296365a21d0ba4b57412325cdb85a70bfd241b60e16fe785966b5d81464d2
Jul 20 22:24:00.372893 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.372869    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4"]
Jul 20 22:24:00.376220 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:24:00.376196    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf89b3b8_bba0_4bc0_bf1c_42253907a429.slice/crio-57af4ec54990af3944dda6c36d12db4f43d138463814f041f099f7e7fb74752d WatchSource:0}: Error finding container 57af4ec54990af3944dda6c36d12db4f43d138463814f041f099f7e7fb74752d: Status 404 returned error can't find the container with id 57af4ec54990af3944dda6c36d12db4f43d138463814f041f099f7e7fb74752d
Jul 20 22:24:00.457356 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.457324    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:00.473265 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.473232    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l" event={"ID":"07a77fa1-fdb4-4af4-99d4-d46df3c3161d","Type":"ContainerStarted","Data":"d8f296365a21d0ba4b57412325cdb85a70bfd241b60e16fe785966b5d81464d2"}
Jul 20 22:24:00.474216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.474195    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4" event={"ID":"bf89b3b8-bba0-4bc0-bf1c-42253907a429","Type":"ContainerStarted","Data":"57af4ec54990af3944dda6c36d12db4f43d138463814f041f099f7e7fb74752d"}
Jul 20 22:24:00.475803 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.475786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pjwz6" event={"ID":"ec578931-06be-4194-abef-b6adaf903b2c","Type":"ContainerStarted","Data":"5eea794f07795be64f08862760863032776323febe3edb88be7e4778244c318c"}
Jul 20 22:24:00.744948 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.744910    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:00.846526 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:00.846492    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:02.450084 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:02.450047    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r9tzs"
Jul 20 22:24:02.630603 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:02.630568    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:02.734529 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:02.734389    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:02.834811 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:02.834772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:03.781899 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.781862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:24:03.784494 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.784463    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 22:24:03.794986 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.794960    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d7b2314-23d4-4538-973f-ec96e28a1b7f-metrics-certs\") pod \"network-metrics-daemon-b7hjs\" (UID: \"6d7b2314-23d4-4538-973f-ec96e28a1b7f\") " pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:24:03.882504 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.882467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:24:03.882680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.882523    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:24:03.884903 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.884879    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 22:24:03.885013 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.884885    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 22:24:03.889901 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.889872    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-br7rv\""
Jul 20 22:24:03.895680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.895649    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 22:24:03.896113 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.896088    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/933fd8ef-d979-4fb3-a1ec-8b914e77aae4-original-pull-secret\") pod \"global-pull-secret-syncer-rhs8q\" (UID: \"933fd8ef-d979-4fb3-a1ec-8b914e77aae4\") " pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:24:03.898529 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.898510    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b7hjs"
Jul 20 22:24:03.906351 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:03.906327    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lct2c\" (UniqueName: \"kubernetes.io/projected/aff9386a-9259-4ab3-875e-cf6c0fdeee7f-kube-api-access-lct2c\") pod \"network-check-target-74244\" (UID: \"aff9386a-9259-4ab3-875e-cf6c0fdeee7f\") " pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:24:04.179412 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:04.179374    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sk5f6\""
Jul 20 22:24:04.182684 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:04.182660    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rhs8q"
Jul 20 22:24:04.186604 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:04.186565    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:24:05.325243 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:05.325213    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:05.425713 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:05.425662    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:05.529932 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:05.529882    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:05.955035 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:05.954989    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:06.112429 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:06.112314    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:06.231597 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:06.231515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:06.561432 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:06.561392    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:06.666334 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:06.666290    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:08.211766 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.211588    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-74244"]
Jul 20 22:24:08.216005 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:24:08.215979    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff9386a_9259_4ab3_875e_cf6c0fdeee7f.slice/crio-52bcd8066013b438c9a4a87a5603d739cfcce6e8b3c85e916c83c3a8ba26c9f2 WatchSource:0}: Error finding container 52bcd8066013b438c9a4a87a5603d739cfcce6e8b3c85e916c83c3a8ba26c9f2: Status 404 returned error can't find the container with id 52bcd8066013b438c9a4a87a5603d739cfcce6e8b3c85e916c83c3a8ba26c9f2
Jul 20 22:24:08.369990 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.369962    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:08.436590 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.436563    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rhs8q"]
Jul 20 22:24:08.439767 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:24:08.439737    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933fd8ef_d979_4fb3_a1ec_8b914e77aae4.slice/crio-b186492a27118c5b5f0c6585622a14acb1420cee9e6b14dfe69e78f8652bdde3 WatchSource:0}: Error finding container b186492a27118c5b5f0c6585622a14acb1420cee9e6b14dfe69e78f8652bdde3: Status 404 returned error can't find the container with id b186492a27118c5b5f0c6585622a14acb1420cee9e6b14dfe69e78f8652bdde3
Jul 20 22:24:08.440284 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.440264    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b7hjs"]
Jul 20 22:24:08.440965 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.440939    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:08.444193 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:24:08.444173    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7b2314_23d4_4538_973f_ec96e28a1b7f.slice/crio-e163ecdf4ed9b7966b00337bbf2e0075a5fbae38889d58e8dab69b9c85c170a4 WatchSource:0}: Error finding container e163ecdf4ed9b7966b00337bbf2e0075a5fbae38889d58e8dab69b9c85c170a4: Status 404 returned error can't find the container with id e163ecdf4ed9b7966b00337bbf2e0075a5fbae38889d58e8dab69b9c85c170a4
Jul 20 22:24:08.509299 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.509262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rhs8q" event={"ID":"933fd8ef-d979-4fb3-a1ec-8b914e77aae4","Type":"ContainerStarted","Data":"b186492a27118c5b5f0c6585622a14acb1420cee9e6b14dfe69e78f8652bdde3"}
Jul 20 22:24:08.510959 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.510932    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l" event={"ID":"07a77fa1-fdb4-4af4-99d4-d46df3c3161d","Type":"ContainerStarted","Data":"602e2ef16b0f5ea9023b3daf8d525995f07e383ac19ca39b5afd8a7c6af66ed4"}
Jul 20 22:24:08.511084 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.511068    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:24:08.513100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.513079    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l"
Jul 20 22:24:08.513250 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.513225    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4" event={"ID":"bf89b3b8-bba0-4bc0-bf1c-42253907a429","Type":"ContainerStarted","Data":"1dd397abcf0aa2d994af94b0d58878d32c91bf13af2a0a56285adc6b4a5e6d06"}
Jul 20 22:24:08.513309 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.513262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4" event={"ID":"bf89b3b8-bba0-4bc0-bf1c-42253907a429","Type":"ContainerStarted","Data":"5a0d22cac7c5427e27d2bfc34b436cc0ab77c516739f2d4ad6f6efcb0eb42834"}
Jul 20 22:24:08.513309 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.513281    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4" event={"ID":"bf89b3b8-bba0-4bc0-bf1c-42253907a429","Type":"ContainerStarted","Data":"8b4c23288198db86c9b13ead1b0364f5028936568fd61c16e74f2811ca2d7d53"}
Jul 20 22:24:08.515247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.515227    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pjwz6" event={"ID":"ec578931-06be-4194-abef-b6adaf903b2c","Type":"ContainerStarted","Data":"968f870441b387e2f739297e9e640195b9c4a615eacde5a6e165accd60409752"}
Jul 20 22:24:08.517813 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.517788    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-74244" event={"ID":"aff9386a-9259-4ab3-875e-cf6c0fdeee7f","Type":"ContainerStarted","Data":"52bcd8066013b438c9a4a87a5603d739cfcce6e8b3c85e916c83c3a8ba26c9f2"}
Jul 20 22:24:08.518836 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.518814    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7hjs" event={"ID":"6d7b2314-23d4-4538-973f-ec96e28a1b7f","Type":"ContainerStarted","Data":"e163ecdf4ed9b7966b00337bbf2e0075a5fbae38889d58e8dab69b9c85c170a4"}
Jul 20 22:24:08.533126 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.533069    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58865588f4-hg86l" podStartSLOduration=3.838281505 podStartE2EDuration="11.533056148s" totalImagesPullingTime="7.694774643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:08.532721209 +0000 UTC m=+69.923976401" watchObservedRunningTime="2026-07-20 22:24:08.533056148 +0000 UTC m=+69.924311321"
Jul 20 22:24:08.552686 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.552641    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5479f497cf-k9bv4" podStartSLOduration=3.84849512 podStartE2EDuration="11.552626888s" totalImagesPullingTime="7.704131768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:08.551834035 +0000 UTC m=+69.943089250" watchObservedRunningTime="2026-07-20 22:24:08.552626888 +0000 UTC m=+69.943882062"
Jul 20 22:24:08.570960 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:08.570919    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pjwz6" podStartSLOduration=17.563741354 podStartE2EDuration="34.570907192s" totalImagesPullingTime="17.007165838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:08.570275069 +0000 UTC m=+69.961530267" watchObservedRunningTime="2026-07-20 22:24:08.570907192 +0000 UTC m=+69.962162388"
Jul 20 22:24:09.540148 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:09.540074    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:09.611311 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:09.611279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:09.855547 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:09.855475    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:10.529909 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:10.529871    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7hjs" event={"ID":"6d7b2314-23d4-4538-973f-ec96e28a1b7f","Type":"ContainerStarted","Data":"727c43cd3e75f22dbe717b50c7155104e90c67ec2e5ebd6bb97159bf13acfac1"}
Jul 20 22:24:10.530077 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:10.529959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b7hjs" event={"ID":"6d7b2314-23d4-4538-973f-ec96e28a1b7f","Type":"ContainerStarted","Data":"427146ba7533f59d3807eaed0f5ba0de8a450cbbb165d6b6cfb69e065633d4ce"}
Jul 20 22:24:10.741469 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:10.741406    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:10.842247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:10.842197    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:11.626290 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:11.626250    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:11.735237 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:11.735200    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:13.036952 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.036918    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:13.158812 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.158722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:13.259070 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.259030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:13.541765 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.541654    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rhs8q" event={"ID":"933fd8ef-d979-4fb3-a1ec-8b914e77aae4","Type":"ContainerStarted","Data":"82dd414015e41db328eb4de1a6dbfa0036c5f43f7d2f4585fefd12ce940d6de9"}
Jul 20 22:24:13.542994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.542971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-74244" event={"ID":"aff9386a-9259-4ab3-875e-cf6c0fdeee7f","Type":"ContainerStarted","Data":"3924bc429c3e28e6c6bc752c3bf3e5ba3b7fe6d266034f9a8cb02ce62a41ecc7"}
Jul 20 22:24:13.543106 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.543095    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:24:13.559923 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.559863    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rhs8q" podStartSLOduration=70.136414864 podStartE2EDuration="1m14.559846782s" totalImagesPullingTime="4.423431918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:13.559286216 +0000 UTC m=+74.950541413" watchObservedRunningTime="2026-07-20 22:24:13.559846782 +0000 UTC m=+74.951101981"
Jul 20 22:24:13.560072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.560052    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b7hjs" podStartSLOduration=73.462902146 podStartE2EDuration="1m14.560046744s" totalImagesPullingTime="1.097144598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:10.566227726 +0000 UTC m=+71.957482947" watchObservedRunningTime="2026-07-20 22:24:13.560046744 +0000 UTC m=+74.951301974"
Jul 20 22:24:13.579573 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:13.579500    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-74244" podStartSLOduration=69.936263351 podStartE2EDuration="1m14.579485118s" totalImagesPullingTime="4.643221767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:13.579259023 +0000 UTC m=+74.970514230" watchObservedRunningTime="2026-07-20 22:24:13.579485118 +0000 UTC m=+74.970740314"
Jul 20 22:24:14.700039 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.700005    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:14.921382 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.921344    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:14.991372 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.991277    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p6fcc"]
Jul 20 22:24:14.994653 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.994630    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:14.997278 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.997254    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 22:24:14.997400 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.997264    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 22:24:14.997400 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.997390    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 22:24:14.997503 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.997439    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 22:24:14.998145 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.998128    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cdfk7\""
Jul 20 22:24:14.998198 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.998148    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 22:24:14.998198 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:14.998148    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 22:24:15.033297 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.033257    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:15.073590 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073559    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-root\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.073590 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073592    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-sys\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.073827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073617    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.073827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073677    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-accelerators-collector-config\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.073827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b23f5619-77da-4344-8adc-5207f23fa844-metrics-client-ca\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.073827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073741    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-tls\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.073827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-wtmp\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.073977 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073833    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r7sq\" (UniqueName: \"kubernetes.io/projected/b23f5619-77da-4344-8adc-5207f23fa844-kube-api-access-7r7sq\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.073977 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.073858    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-textfile\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.118302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.118251    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:15.175100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175072    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-accelerators-collector-config\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175106    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b23f5619-77da-4344-8adc-5207f23fa844-metrics-client-ca\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-tls\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-wtmp\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r7sq\" (UniqueName: \"kubernetes.io/projected/b23f5619-77da-4344-8adc-5207f23fa844-kube-api-access-7r7sq\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-textfile\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175258 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-root\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175544 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:24:15.175262    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 22:24:15.175544 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175309    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-sys\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175544 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175267    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-sys\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175544 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:24:15.175331    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-tls podName:b23f5619-77da-4344-8adc-5207f23fa844 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:15.675308844 +0000 UTC m=+77.066564018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-tls") pod "node-exporter-p6fcc" (UID: "b23f5619-77da-4344-8adc-5207f23fa844") : secret "node-exporter-tls" not found
Jul 20 22:24:15.175544 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175334    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-root\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175544 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-wtmp\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175544 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175899 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175714    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-accelerators-collector-config\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.175899 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175789    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b23f5619-77da-4344-8adc-5207f23fa844-metrics-client-ca\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.176018 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.175997    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-textfile\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.177761 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.177743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.185610 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.185590    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r7sq\" (UniqueName: \"kubernetes.io/projected/b23f5619-77da-4344-8adc-5207f23fa844-kube-api-access-7r7sq\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.218439 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.218405    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:15.322414 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.322379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:15.649408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.649311    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:15.679393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.679363    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-tls\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.681581 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.681561    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b23f5619-77da-4344-8adc-5207f23fa844-node-exporter-tls\") pod \"node-exporter-p6fcc\" (UID: \"b23f5619-77da-4344-8adc-5207f23fa844\") " pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.817072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.817042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:15.903094 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.903016    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p6fcc"
Jul 20 22:24:15.913985 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:24:15.913948    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb23f5619_77da_4344_8adc_5207f23fa844.slice/crio-f57e91e471a26fe42b9a4941a63330e2d01b50331d108303867001e91b02043e WatchSource:0}: Error finding container f57e91e471a26fe42b9a4941a63330e2d01b50331d108303867001e91b02043e: Status 404 returned error can't find the container with id f57e91e471a26fe42b9a4941a63330e2d01b50331d108303867001e91b02043e
Jul 20 22:24:15.921653 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:15.921627    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:16.021328 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:16.021285    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:16.337536 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:16.337508    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:16.554354 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:16.554308    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p6fcc" event={"ID":"b23f5619-77da-4344-8adc-5207f23fa844","Type":"ContainerStarted","Data":"f57e91e471a26fe42b9a4941a63330e2d01b50331d108303867001e91b02043e"}
Jul 20 22:24:17.014589 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:17.014539    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:17.464674 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:17.464641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:17.562678 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:17.562641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:17.563672 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:17.563647    2572 generic.go:356] "Generic (PLEG): container finished" podID="b23f5619-77da-4344-8adc-5207f23fa844" containerID="afbfa1b71c8085f04b75ccbcc705f5b2b186f1828b42410b9759902938481e24" exitCode=0
Jul 20 22:24:17.563776 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:17.563739    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p6fcc" event={"ID":"b23f5619-77da-4344-8adc-5207f23fa844","Type":"ContainerDied","Data":"afbfa1b71c8085f04b75ccbcc705f5b2b186f1828b42410b9759902938481e24"}
Jul 20 22:24:17.702873 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:17.702845    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:17.804912 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:17.804879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:17.937908 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:17.937874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:18.028511 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:18.028472    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:18.283456 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:18.283367    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:18.369853 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:18.369814    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:18.520141 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:18.520108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:18.571143 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:18.571109    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p6fcc" event={"ID":"b23f5619-77da-4344-8adc-5207f23fa844","Type":"ContainerStarted","Data":"c9d9b01dfdb80506d774c4b6d4b6c11d5289bab3acee544ea3cea533b6b0ee03"}
Jul 20 22:24:18.571143 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:18.571160    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p6fcc" event={"ID":"b23f5619-77da-4344-8adc-5207f23fa844","Type":"ContainerStarted","Data":"73d2195283cf54196b3f4d118cb1d7f5b709d17cffa13ed328128ab4474f1f66"}
Jul 20 22:24:18.595815 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:18.595765    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p6fcc" podStartSLOduration=3.52339615 podStartE2EDuration="4.595749667s" totalImagesPullingTime="1.008517857s" totalInitContainerRuntime="63.83566ms" isStatefulPod=true podCreationTimestamp="2026-07-20 22:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:18.594490588 +0000 UTC m=+79.985745784" watchObservedRunningTime="2026-07-20 22:24:18.595749667 +0000 UTC m=+79.987004863"
Jul 20 22:24:19.735834 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:19.735800    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:19.802953 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:19.802914    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:20.374409 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:20.374375    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:21.278914 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.278875    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:21.283424 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.283395    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:24:21.288969 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.288949    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.293531 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.293514    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 22:24:21.293768 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.293751    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-51o2q1csmfu8e\""
Jul 20 22:24:21.293874 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.293752    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 22:24:21.294414 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.294399    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 22:24:21.294956 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.294935    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j7nlw\""
Jul 20 22:24:21.294956 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.294951    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 22:24:21.295138 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.294987    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 22:24:21.296610 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.296578    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 22:24:21.296730 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.296630    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 22:24:21.296986 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.296961    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 22:24:21.296986 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.296980    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 22:24:21.297139 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.296980    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 22:24:21.297139 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.297055    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 22:24:21.297139 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.297067    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 22:24:21.297419 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.297404    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 22:24:21.300417 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.300401    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 22:24:21.304442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.304423    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 22:24:21.313874 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.313849    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:24:21.421760 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421725    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.421760 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421760    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.421972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.421972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421834    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.421972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421866    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-config-out\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.421972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421887    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.421972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.421972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421952    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.421972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421970    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.421990    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422074    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-config\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-web-config\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422199    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqqt8\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-kube-api-access-mqqt8\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.422550 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.422262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.522963 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.522930    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.522963 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.522964    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.522982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.522998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523014    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-config\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523055    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523112    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523136    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-web-config\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523163    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523182    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523202    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqqt8\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-kube-api-access-mqqt8\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523222    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523248    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523339    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523365    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-config-out\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.523588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.524062 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523744    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.524062 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.523913    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.524062 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.524045    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.524351 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.524329    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.525008 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.524984    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.526389 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.526212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.526389 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.526258    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.526389 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.526312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-config\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.526597 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.526499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.526914 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.526816    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-web-config\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.526914 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.526849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.527058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.526999    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.527453 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.527401    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.527707 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.527668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.528234 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.528210    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.528548 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.528527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.529168 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.529114    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-config-out\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.529249 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.529215    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.529757 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.529740    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.532810 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.532794    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqqt8\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-kube-api-access-mqqt8\") pod \"prometheus-k8s-0\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.598874 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.598847    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:21.736275 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:21.736244    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:24:21.739031 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:24:21.739004    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod103cb474_047d_45e7_83fe_3ee67baa9887.slice/crio-170f8cda2d36448bd0791c09d335db6422b501a4201c49980daeeb6e3e7ee609 WatchSource:0}: Error finding container 170f8cda2d36448bd0791c09d335db6422b501a4201c49980daeeb6e3e7ee609: Status 404 returned error can't find the container with id 170f8cda2d36448bd0791c09d335db6422b501a4201c49980daeeb6e3e7ee609
Jul 20 22:24:22.585398 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:22.585363    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerStarted","Data":"170f8cda2d36448bd0791c09d335db6422b501a4201c49980daeeb6e3e7ee609"}
Jul 20 22:24:23.590100 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:23.590060    2572 generic.go:356] "Generic (PLEG): container finished" podID="103cb474-047d-45e7-83fe-3ee67baa9887" containerID="a5307c112d8d997cb9d439a6eb166cb23fe64de2b2451cd58c2d7738dbeedf0c" exitCode=0
Jul 20 22:24:23.590455 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:23.590133    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerDied","Data":"a5307c112d8d997cb9d439a6eb166cb23fe64de2b2451cd58c2d7738dbeedf0c"}
Jul 20 22:24:25.021714 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:25.021669    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:25.117152 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:25.117115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:25.216489 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:25.216411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:25.337868 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:25.337824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:25.439133 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:25.439093    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:25.522209 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:25.522164    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:27.607761 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:27.607727    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerStarted","Data":"db56e71d3ad63f1b17449fc48ef6d17dde3f5e51d06d011cc8a437fc9a9f8dc4"}
Jul 20 22:24:28.162549 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:28.162516    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:28.263138 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:28.263101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:28.614517 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:28.614481    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerStarted","Data":"4067ed763ccdd86bb2755cf2cf88b4b108354407326c8f62cdf7d911e12bf5ea"}
Jul 20 22:24:29.622165 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:29.622133    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerStarted","Data":"89ef145fe2fb84cfb9019a891122a8517d76c1a90e9c509f79bc866f9b1db53d"}
Jul 20 22:24:29.622572 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:29.622218    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerStarted","Data":"12fe2c0118fe016c8266d996ed47b764f2417a56b504dbfb8c89b9fb42537732"}
Jul 20 22:24:30.629059 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:30.629023    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerStarted","Data":"9398b2887bf6702d19e018fe3e52a98cb52a316bb0664ba4e1ec3f24a499ea41"}
Jul 20 22:24:30.629530 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:30.629100    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerStarted","Data":"4da1a0cb4c53b9e07a3d7bd8d464bd02c2cf84107defeae08e65b32463733d71"}
Jul 20 22:24:30.664124 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:30.664064    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.909042573 podStartE2EDuration="9.664044998s" totalImagesPullingTime="6.73732956s" totalInitContainerRuntime="17.672865ms" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:30.661864946 +0000 UTC m=+92.053120152" watchObservedRunningTime="2026-07-20 22:24:30.664044998 +0000 UTC m=+92.055300195"
Jul 20 22:24:31.599320 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:31.599278    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:24:32.751256 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:32.751208    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:32.874431 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:32.874396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:34.431233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:34.431182    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:34.511470 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:34.511438    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:35.012628 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:35.012587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:38.282098 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:38.282058    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:40.280471 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:40.280434    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:40.396062 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:40.396026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:40.537516 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:40.537404    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:42.597079 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:42.597046    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:42.697785 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:42.697741    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:42.765790 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:42.765752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:44.549082 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:44.549053    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-74244"
Jul 20 22:24:47.688023 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:47.687987    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:24:47.748746 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:24:47.748709    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:21.600093 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:21.600035    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:21.618758 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:21.618734    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:21.813103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:21.813078    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:31.118427 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:31.118387    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:31.179742 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:31.179685    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:32.557483 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:32.557451    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:32.621163 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:32.621126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:39.667910 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.667875    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:39.668310 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.668190    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="prometheus" containerID="cri-o://db56e71d3ad63f1b17449fc48ef6d17dde3f5e51d06d011cc8a437fc9a9f8dc4" gracePeriod=600
Jul 20 22:25:39.668310 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.668212    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9398b2887bf6702d19e018fe3e52a98cb52a316bb0664ba4e1ec3f24a499ea41" gracePeriod=600
Jul 20 22:25:39.668310 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.668239    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="thanos-sidecar" containerID="cri-o://12fe2c0118fe016c8266d996ed47b764f2417a56b504dbfb8c89b9fb42537732" gracePeriod=600
Jul 20 22:25:39.668310 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.668255    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="config-reloader" containerID="cri-o://4067ed763ccdd86bb2755cf2cf88b4b108354407326c8f62cdf7d911e12bf5ea" gracePeriod=600
Jul 20 22:25:39.668531 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.668257    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy-web" containerID="cri-o://89ef145fe2fb84cfb9019a891122a8517d76c1a90e9c509f79bc866f9b1db53d" gracePeriod=600
Jul 20 22:25:39.668531 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.668262    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy" containerID="cri-o://4da1a0cb4c53b9e07a3d7bd8d464bd02c2cf84107defeae08e65b32463733d71" gracePeriod=600
Jul 20 22:25:39.861060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861026    2572 generic.go:356] "Generic (PLEG): container finished" podID="103cb474-047d-45e7-83fe-3ee67baa9887" containerID="9398b2887bf6702d19e018fe3e52a98cb52a316bb0664ba4e1ec3f24a499ea41" exitCode=0
Jul 20 22:25:39.861060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861056    2572 generic.go:356] "Generic (PLEG): container finished" podID="103cb474-047d-45e7-83fe-3ee67baa9887" containerID="4da1a0cb4c53b9e07a3d7bd8d464bd02c2cf84107defeae08e65b32463733d71" exitCode=0
Jul 20 22:25:39.861060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861063    2572 generic.go:356] "Generic (PLEG): container finished" podID="103cb474-047d-45e7-83fe-3ee67baa9887" containerID="89ef145fe2fb84cfb9019a891122a8517d76c1a90e9c509f79bc866f9b1db53d" exitCode=0
Jul 20 22:25:39.861060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861069    2572 generic.go:356] "Generic (PLEG): container finished" podID="103cb474-047d-45e7-83fe-3ee67baa9887" containerID="12fe2c0118fe016c8266d996ed47b764f2417a56b504dbfb8c89b9fb42537732" exitCode=0
Jul 20 22:25:39.861385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861076    2572 generic.go:356] "Generic (PLEG): container finished" podID="103cb474-047d-45e7-83fe-3ee67baa9887" containerID="4067ed763ccdd86bb2755cf2cf88b4b108354407326c8f62cdf7d911e12bf5ea" exitCode=0
Jul 20 22:25:39.861385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861084    2572 generic.go:356] "Generic (PLEG): container finished" podID="103cb474-047d-45e7-83fe-3ee67baa9887" containerID="db56e71d3ad63f1b17449fc48ef6d17dde3f5e51d06d011cc8a437fc9a9f8dc4" exitCode=0
Jul 20 22:25:39.861385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861095    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerDied","Data":"9398b2887bf6702d19e018fe3e52a98cb52a316bb0664ba4e1ec3f24a499ea41"}
Jul 20 22:25:39.861385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861180    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerDied","Data":"4da1a0cb4c53b9e07a3d7bd8d464bd02c2cf84107defeae08e65b32463733d71"}
Jul 20 22:25:39.861385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerDied","Data":"89ef145fe2fb84cfb9019a891122a8517d76c1a90e9c509f79bc866f9b1db53d"}
Jul 20 22:25:39.861385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861261    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerDied","Data":"12fe2c0118fe016c8266d996ed47b764f2417a56b504dbfb8c89b9fb42537732"}
Jul 20 22:25:39.861385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerDied","Data":"4067ed763ccdd86bb2755cf2cf88b4b108354407326c8f62cdf7d911e12bf5ea"}
Jul 20 22:25:39.861385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.861343    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerDied","Data":"db56e71d3ad63f1b17449fc48ef6d17dde3f5e51d06d011cc8a437fc9a9f8dc4"}
Jul 20 22:25:39.902404 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:39.902381    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:40.013387 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013294    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-tls-assets\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013387 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013342    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-metrics-client-certs\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013387 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013370    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-grpc-tls\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013400    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-trusted-ca-bundle\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013423    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-kube-rbac-proxy\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013451    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqqt8\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-kube-api-access-mqqt8\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013476    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013503    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-web-config\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013531    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-0\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013556    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013593    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-kubelet-serving-ca-bundle\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.013645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013628    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-tls\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013658    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-1\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013716    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-2\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013746    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-config\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013773    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-thanos-prometheus-http-client-file\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013809    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-db\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013847    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-config-out\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013886    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-metrics-client-ca\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.013922    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-serving-certs-ca-bundle\") pod \"103cb474-047d-45e7-83fe-3ee67baa9887\" (UID: \"103cb474-047d-45e7-83fe-3ee67baa9887\") "
Jul 20 22:25:40.014538 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.014117    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:40.014538 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.014487    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:40.014538 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.014504    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:40.015859 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.015831    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:40.016419 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.016174    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:40.016522 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.016461    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.016821 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.016790    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.016907 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.016834    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-config" (OuterVolumeSpecName: "config") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.016907 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.016885    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.017143 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.017110    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-kube-api-access-mqqt8" (OuterVolumeSpecName: "kube-api-access-mqqt8") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "kube-api-access-mqqt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:40.017271 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.017234    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:40.017869 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.017598    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:40.017967 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.017904    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.018114 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.018089    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:40.018170 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.018136    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:25:40.018299 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.018280    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.018736 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.018720    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.019065 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.019047    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-config-out" (OuterVolumeSpecName: "config-out") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:25:40.019189 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.019169    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.026066 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.026044    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-web-config" (OuterVolumeSpecName: "web-config") pod "103cb474-047d-45e7-83fe-3ee67baa9887" (UID: "103cb474-047d-45e7-83fe-3ee67baa9887"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:40.115165 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115133    2572 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-tls-assets\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115165 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115162    2572 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-metrics-client-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115165 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115172    2572 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-grpc-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115181    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115191    2572 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-kube-rbac-proxy\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115199    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqqt8\" (UniqueName: \"kubernetes.io/projected/103cb474-047d-45e7-83fe-3ee67baa9887-kube-api-access-mqqt8\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115208    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115219    2572 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-web-config\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115227    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115235    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115244    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115252    2572 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115260    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115269    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115277    2572 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-config\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115285    2572 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/103cb474-047d-45e7-83fe-3ee67baa9887-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115293    2572 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-prometheus-k8s-db\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115301    2572 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/103cb474-047d-45e7-83fe-3ee67baa9887-config-out\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115309    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-metrics-client-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.115393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.115317    2572 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103cb474-047d-45e7-83fe-3ee67baa9887-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:25:40.867439 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.867406    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103cb474-047d-45e7-83fe-3ee67baa9887","Type":"ContainerDied","Data":"170f8cda2d36448bd0791c09d335db6422b501a4201c49980daeeb6e3e7ee609"}
Jul 20 22:25:40.867439 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.867432    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:40.868204 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.868182    2572 scope.go:117] "RemoveContainer" containerID="9398b2887bf6702d19e018fe3e52a98cb52a316bb0664ba4e1ec3f24a499ea41"
Jul 20 22:25:40.875601 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.875552    2572 scope.go:117] "RemoveContainer" containerID="4da1a0cb4c53b9e07a3d7bd8d464bd02c2cf84107defeae08e65b32463733d71"
Jul 20 22:25:40.882122 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.882106    2572 scope.go:117] "RemoveContainer" containerID="89ef145fe2fb84cfb9019a891122a8517d76c1a90e9c509f79bc866f9b1db53d"
Jul 20 22:25:40.888362 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.888347    2572 scope.go:117] "RemoveContainer" containerID="12fe2c0118fe016c8266d996ed47b764f2417a56b504dbfb8c89b9fb42537732"
Jul 20 22:25:40.892190 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.892167    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:40.896117 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.896094    2572 scope.go:117] "RemoveContainer" containerID="4067ed763ccdd86bb2755cf2cf88b4b108354407326c8f62cdf7d911e12bf5ea"
Jul 20 22:25:40.896677 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.896658    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:40.902170 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.902149    2572 scope.go:117] "RemoveContainer" containerID="db56e71d3ad63f1b17449fc48ef6d17dde3f5e51d06d011cc8a437fc9a9f8dc4"
Jul 20 22:25:40.908429 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.908413    2572 scope.go:117] "RemoveContainer" containerID="a5307c112d8d997cb9d439a6eb166cb23fe64de2b2451cd58c2d7738dbeedf0c"
Jul 20 22:25:40.922976 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.922956    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:40.923195 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923184    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy-web"
Jul 20 22:25:40.923244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923197    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy-web"
Jul 20 22:25:40.923244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923204    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy"
Jul 20 22:25:40.923244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923210    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy"
Jul 20 22:25:40.923244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923219    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="thanos-sidecar"
Jul 20 22:25:40.923244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923225    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="thanos-sidecar"
Jul 20 22:25:40.923244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923239    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="init-config-reloader"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923246    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="init-config-reloader"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923273    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="prometheus"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923278    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="prometheus"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923284    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy-thanos"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923290    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy-thanos"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923298    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="config-reloader"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923303    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="config-reloader"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923339    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy-web"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923346    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="config-reloader"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923354    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy-thanos"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923359    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="thanos-sidecar"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923364    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="kube-rbac-proxy"
Jul 20 22:25:40.923416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.923369    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" containerName="prometheus"
Jul 20 22:25:40.928194 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.928179    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:40.930919 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.930898    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 22:25:40.931067 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.930953    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 22:25:40.931162 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.931148    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 22:25:40.931269 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.931201    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 22:25:40.931393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.931380    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 22:25:40.931488 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.931427    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 22:25:40.931488 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.931455    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 22:25:40.931584 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.931565    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 22:25:40.932141 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.932124    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-j7nlw\""
Jul 20 22:25:40.932244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.932127    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 22:25:40.932424 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.932381    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 22:25:40.932655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.932612    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 22:25:40.932655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.932645    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 22:25:40.933170 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.933147    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 22:25:40.933604 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.933588    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-51o2q1csmfu8e\""
Jul 20 22:25:40.935471 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.935455    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 22:25:40.938737 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.938721    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 22:25:40.945285 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:40.943772    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:41.023017 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.022981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023017 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023017    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023213 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023213 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-config\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023213 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023100    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023213 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11e66bb1-d515-49f7-9906-28de3b16c0d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023213 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhpr\" (UniqueName: \"kubernetes.io/projected/11e66bb1-d515-49f7-9906-28de3b16c0d5-kube-api-access-jhhpr\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023213 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023202    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023388 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023242    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11e66bb1-d515-49f7-9906-28de3b16c0d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023388 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023276    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023388 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023292    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023388 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023330    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023388 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023350    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023388 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023377    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023560 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023560 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023560 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023444    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023560 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023464    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023560 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023530    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.023727 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.023566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.124847 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.124814    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.124847 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.124847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.124863    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.124879    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-config\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.124894    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.124924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11e66bb1-d515-49f7-9906-28de3b16c0d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.124952    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhpr\" (UniqueName: \"kubernetes.io/projected/11e66bb1-d515-49f7-9906-28de3b16c0d5-kube-api-access-jhhpr\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.124979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125011    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11e66bb1-d515-49f7-9906-28de3b16c0d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125043    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125066    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125143    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125164    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125191    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125223    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125251    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125283    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.125582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.126058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125600    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.126058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125789    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.126058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.125820    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.126221 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.126155    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.126387 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.126357    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.128267 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.128146    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-config\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.128267 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.128231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.128435 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.128307    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.128733 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.128608    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.128893 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.128872    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-web-config\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.129069 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.129047    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.129238 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.129212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.129340 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.129312    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11e66bb1-d515-49f7-9906-28de3b16c0d5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.129537 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.129516    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.130099 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.130077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.130256 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.130236    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11e66bb1-d515-49f7-9906-28de3b16c0d5-config-out\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.131134 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.131108    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.131196 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.131117    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/11e66bb1-d515-49f7-9906-28de3b16c0d5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.131665 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.131649    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/11e66bb1-d515-49f7-9906-28de3b16c0d5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.133777 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.133755    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhpr\" (UniqueName: \"kubernetes.io/projected/11e66bb1-d515-49f7-9906-28de3b16c0d5-kube-api-access-jhhpr\") pod \"prometheus-k8s-0\" (UID: \"11e66bb1-d515-49f7-9906-28de3b16c0d5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.167776 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.167749    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="103cb474-047d-45e7-83fe-3ee67baa9887" path="/var/lib/kubelet/pods/103cb474-047d-45e7-83fe-3ee67baa9887/volumes"
Jul 20 22:25:41.239577 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.239489    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:41.375338 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.375299    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 22:25:41.380340 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:25:41.380315    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e66bb1_d515_49f7_9906_28de3b16c0d5.slice/crio-1a987c36d56f6eaac3686f569ff661e5526ab164b68a3de397cc633cf6914eeb WatchSource:0}: Error finding container 1a987c36d56f6eaac3686f569ff661e5526ab164b68a3de397cc633cf6914eeb: Status 404 returned error can't find the container with id 1a987c36d56f6eaac3686f569ff661e5526ab164b68a3de397cc633cf6914eeb
Jul 20 22:25:41.872495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.872461    2572 generic.go:356] "Generic (PLEG): container finished" podID="11e66bb1-d515-49f7-9906-28de3b16c0d5" containerID="e7d2261e00a4c051e16d01eed3303a09aae88f1b56d6b11318196a4658e3bd9b" exitCode=0
Jul 20 22:25:41.872895 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.872549    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11e66bb1-d515-49f7-9906-28de3b16c0d5","Type":"ContainerDied","Data":"e7d2261e00a4c051e16d01eed3303a09aae88f1b56d6b11318196a4658e3bd9b"}
Jul 20 22:25:41.872895 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:41.872615    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11e66bb1-d515-49f7-9906-28de3b16c0d5","Type":"ContainerStarted","Data":"1a987c36d56f6eaac3686f569ff661e5526ab164b68a3de397cc633cf6914eeb"}
Jul 20 22:25:42.881859 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:42.881827    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11e66bb1-d515-49f7-9906-28de3b16c0d5","Type":"ContainerStarted","Data":"82168eb4e95a9013016ce0fbe6de6d5e769a736c09407d38c4f3602af237dde1"}
Jul 20 22:25:42.882218 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:42.881894    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11e66bb1-d515-49f7-9906-28de3b16c0d5","Type":"ContainerStarted","Data":"6575bdae71026ce08cf41c632dcc33a8a6f77cc2330bfbf8033eca4112a1befe"}
Jul 20 22:25:42.882218 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:42.881923    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11e66bb1-d515-49f7-9906-28de3b16c0d5","Type":"ContainerStarted","Data":"ef25684b26909b15e045580df50037f8a0c26c1ef91d5c8fe9c77cc87381ae1d"}
Jul 20 22:25:42.882218 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:42.881946    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11e66bb1-d515-49f7-9906-28de3b16c0d5","Type":"ContainerStarted","Data":"530cd8ae79222f504f747ef282a6270848a86f3e15cb6366eade37389307f6a4"}
Jul 20 22:25:42.882218 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:42.881972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11e66bb1-d515-49f7-9906-28de3b16c0d5","Type":"ContainerStarted","Data":"382067c80fc32cc113d34dd20e6768eb225bc3564e727c436eb941471317af60"}
Jul 20 22:25:42.882218 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:42.882008    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"11e66bb1-d515-49f7-9906-28de3b16c0d5","Type":"ContainerStarted","Data":"a28b8f7771b528d12e969b0b605619a8804df1d9387c4400a40aba5aa874e3ce"}
Jul 20 22:25:42.914946 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:42.914866    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.895989516 podStartE2EDuration="2.914851929s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.862413ms" isStatefulPod=false podCreationTimestamp="2026-07-20 22:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:25:42.912390155 +0000 UTC m=+164.303645378" watchObservedRunningTime="2026-07-20 22:25:42.914851929 +0000 UTC m=+164.306107125"
Jul 20 22:25:43.147859 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:43.147769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:43.248309 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:43.248268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:43.853420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:43.853383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:43.956324 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:43.956284    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:44.057659 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:44.057622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:46.240232 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:46.240179    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:25:47.703224 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:47.703188    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:25:47.804742 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:25:47.804708    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:26:30.109607 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:26:30.109558    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:26:30.167255 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:26:30.167223    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:26:33.836813 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:26:33.836780    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:26:33.932208 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:26:33.932177    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:26:41.240099 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:26:41.240052    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:26:41.254961 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:26:41.254937    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:26:42.095501 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:26:42.095470    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 22:26:52.210006 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:26:52.209967    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:00.581742 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:00.581706    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:01.418234 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:01.418190    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:04.439746 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:04.439687    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:04.512617 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:04.512586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:06.176772 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:06.176739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:06.325766 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:06.325733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:06.444886 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:06.444808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:06.541843 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:06.541808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:08.777810 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:08.777770    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:09.014570 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:09.014534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:11.502629 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:11.502589    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:11.605533 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:11.605487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:14.809024 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:14.808991    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:14.939915 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:14.939878    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:16.379992 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:16.379959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:20.470157 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:20.470113    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:20.570989 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:20.570957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:22.801770 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:22.801729    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:35.803086 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:35.803046    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:35.892973 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:35.892936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:36.410048 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.410019    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:36.656166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.656133    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:36.765145 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.765061    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:36.829182 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.829154    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"]
Jul 20 22:27:36.832462 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.832444    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:36.834913 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.834888    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 22:27:36.835025 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.834930    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 22:27:36.836254 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.836239    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s6fj4\""
Jul 20 22:27:36.836506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.836487    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 22:27:36.836506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.836502    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 22:27:36.859506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.859477    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"]
Jul 20 22:27:36.905042 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.905006    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-tmp\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:36.905042 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.905038    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:36.905231 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.905059    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:36.905231 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.905131    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-manifests\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:36.905231 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.905167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6ltq\" (UniqueName: \"kubernetes.io/projected/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-kube-api-access-m6ltq\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:36.970385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:36.970355    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:37.006202 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.006168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6ltq\" (UniqueName: \"kubernetes.io/projected/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-kube-api-access-m6ltq\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.006338 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.006250    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-tmp\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.006338 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.006278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.006338 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.006301    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.006457 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.006344    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-manifests\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.006778 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.006759    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-manifests\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.008682 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.008653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-tmp\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.008818 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.008800    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.008904 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.008887    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.020592 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.020530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6ltq\" (UniqueName: \"kubernetes.io/projected/d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58-kube-api-access-m6ltq\") pod \"opendatahub-operator-controller-manager-6795f5f468-h6rs9\" (UID: \"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.092641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.092609    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:37.142165 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.142135    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:37.203657 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.203567    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:37.275072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.275008    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"]
Jul 20 22:27:37.277889 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:27:37.277862    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ca00b7_2cf7_4a5d_81a0_fd8e2d11ba58.slice/crio-77da32c44039dc00181d35c7689d05c54baa3baa83862a95a20599f1c21d3612 WatchSource:0}: Error finding container 77da32c44039dc00181d35c7689d05c54baa3baa83862a95a20599f1c21d3612: Status 404 returned error can't find the container with id 77da32c44039dc00181d35c7689d05c54baa3baa83862a95a20599f1c21d3612
Jul 20 22:27:37.285502 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.285457    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:37.396572 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:37.396539    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:38.262903 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:38.262862    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9" event={"ID":"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58","Type":"ContainerStarted","Data":"77da32c44039dc00181d35c7689d05c54baa3baa83862a95a20599f1c21d3612"}
Jul 20 22:27:40.649827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:40.649784    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:40.750555 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:40.750522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:41.275291 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:41.275251    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9" event={"ID":"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58","Type":"ContainerStarted","Data":"86817855c7626cfe821ba0f2dea4578a06f1007c3e3ed12f8e9ed51c96d38466"}
Jul 20 22:27:42.280376 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:42.280339    2572 generic.go:356] "Generic (PLEG): container finished" podID="d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58" containerID="86817855c7626cfe821ba0f2dea4578a06f1007c3e3ed12f8e9ed51c96d38466" exitCode=0
Jul 20 22:27:42.280763 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:42.280395    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9" event={"ID":"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58","Type":"ContainerDied","Data":"86817855c7626cfe821ba0f2dea4578a06f1007c3e3ed12f8e9ed51c96d38466"}
Jul 20 22:27:43.285434 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:43.285394    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9" event={"ID":"d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58","Type":"ContainerStarted","Data":"090f5615df3a07eae146269f9ea5d4baf91d691bc4ff79f85dc05a3e3c81bb1e"}
Jul 20 22:27:43.285807 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:43.285539    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:43.324822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:43.324778    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9" podStartSLOduration=2.947914911 podStartE2EDuration="7.324756197s" totalImagesPullingTime="3.351541883s" totalInitContainerRuntime="1.025299403s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:27:43.323038219 +0000 UTC m=+284.714293446" watchObservedRunningTime="2026-07-20 22:27:43.324756197 +0000 UTC m=+284.716011443"
Jul 20 22:27:45.080194 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:45.080166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:45.208237 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:45.208211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:54.210430 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:54.210393    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:54.290635 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:54.290601    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-h6rs9"
Jul 20 22:27:55.453279 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:55.453248    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:56.117356 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.117319    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"]
Jul 20 22:27:56.122396 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.122373    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.130456 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.130435    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n9fr8\""
Jul 20 22:27:56.132988 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.132974    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 22:27:56.133131 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.133098    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 22:27:56.133235 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.133152    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 22:27:56.133881 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.133867    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:27:56.133931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.133880    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 22:27:56.140032 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.140007    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"]
Jul 20 22:27:56.146298 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.146274    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-metrics-cert\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.146408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.146329    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-manager-config\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.146408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.146373    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42m8z\" (UniqueName: \"kubernetes.io/projected/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-kube-api-access-42m8z\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.146408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.146398    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-cert\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.246783 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.246754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-metrics-cert\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.246952 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.246816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-manager-config\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.246952 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.246845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42m8z\" (UniqueName: \"kubernetes.io/projected/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-kube-api-access-42m8z\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.246952 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.246891    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-cert\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.247578 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.247554    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-manager-config\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.249313 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.249291    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-cert\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.249436 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.249420    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-metrics-cert\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.274547 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.274511    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42m8z\" (UniqueName: \"kubernetes.io/projected/10ae8361-94bb-45d4-ac10-6fda4b4f7ac9-kube-api-access-42m8z\") pod \"lws-controller-manager-cb4c45cc6-n6nhz\" (UID: \"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9\") " pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.303014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.302986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:56.431131 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.431048    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:56.478575 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.478499    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:56.620733 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:56.620709    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"]
Jul 20 22:27:56.622143 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:27:56.622111    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10ae8361_94bb_45d4_ac10_6fda4b4f7ac9.slice/crio-1396f77f29ca7892cf628d2ecc8fbcdade34efe05697afc194fa99be2a150952 WatchSource:0}: Error finding container 1396f77f29ca7892cf628d2ecc8fbcdade34efe05697afc194fa99be2a150952: Status 404 returned error can't find the container with id 1396f77f29ca7892cf628d2ecc8fbcdade34efe05697afc194fa99be2a150952
Jul 20 22:27:57.140067 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.140033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:57.179031 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.179005    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"]
Jul 20 22:27:57.181308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.181292    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.184645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.184621    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 22:27:57.184777 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.184685    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 22:27:57.185413 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.185395    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jn7qw\""
Jul 20 22:27:57.193101 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.193084    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 22:27:57.193192 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.193125    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 22:27:57.206232 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.206213    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"]
Jul 20 22:27:57.256836 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.256811    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-tmp\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.256964 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.256904    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-tls-certs\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.256964 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.256935    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x9b2\" (UniqueName: \"kubernetes.io/projected/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-kube-api-access-7x9b2\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.333978 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.333938    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz" event={"ID":"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9","Type":"ContainerStarted","Data":"1396f77f29ca7892cf628d2ecc8fbcdade34efe05697afc194fa99be2a150952"}
Jul 20 22:27:57.358390 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.358305    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-tls-certs\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.358390 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.358352    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x9b2\" (UniqueName: \"kubernetes.io/projected/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-kube-api-access-7x9b2\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.358603 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.358397    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-tmp\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.361786 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.361760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-tls-certs\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.363055 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.363031    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-tmp\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.376594 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.375299    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x9b2\" (UniqueName: \"kubernetes.io/projected/d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb-kube-api-access-7x9b2\") pod \"kube-auth-proxy-5957d7d59-b9gkc\" (UID: \"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.449933 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.449824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:57.490935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.490900    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"
Jul 20 22:27:57.611688 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.611626    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:57.704707 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.704668    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc"]
Jul 20 22:27:57.708041 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:27:57.708010    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd100fcbd_e55f_4ff4_b53b_7de2dfaf40cb.slice/crio-82c71c55e09d07c1fe710512b19bb068ee39dc95feb730e7ff9954c62ae480c5 WatchSource:0}: Error finding container 82c71c55e09d07c1fe710512b19bb068ee39dc95feb730e7ff9954c62ae480c5: Status 404 returned error can't find the container with id 82c71c55e09d07c1fe710512b19bb068ee39dc95feb730e7ff9954c62ae480c5
Jul 20 22:27:57.995376 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:57.995290    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:58.274211 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:58.274107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:58.339590 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:58.339558    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc" event={"ID":"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb","Type":"ContainerStarted","Data":"82c71c55e09d07c1fe710512b19bb068ee39dc95feb730e7ff9954c62ae480c5"}
Jul 20 22:27:58.446452 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:58.446414    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:59.027328 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:59.027308    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 22:27:59.344610 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:59.344576    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz" event={"ID":"10ae8361-94bb-45d4-ac10-6fda4b4f7ac9","Type":"ContainerStarted","Data":"66d6b49d48ab3f235400bf29ebd969387173b4bf61842af057510ae9e56977c8"}
Jul 20 22:27:59.344853 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:59.344719    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:27:59.351006 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:59.350977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:27:59.528514 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:27:59.528482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:00.066906 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:00.066868    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:00.191840 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:00.191803    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:00.628429 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:00.628401    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 22:28:01.182212 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:01.182174    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:01.352849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:01.352816    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc" event={"ID":"d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb","Type":"ContainerStarted","Data":"907407df7962524dbc2b0aba23134e445ea96f1d414bbca5116befb3dc41a7b3"}
Jul 20 22:28:01.375733 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:01.375662    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz" podStartSLOduration=2.933139212 podStartE2EDuration="5.375645217s" totalImagesPullingTime="2.442506005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:27:59.423003287 +0000 UTC m=+300.814258508" watchObservedRunningTime="2026-07-20 22:28:01.375645217 +0000 UTC m=+302.766900413"
Jul 20 22:28:01.376369 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:01.376325    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5957d7d59-b9gkc" podStartSLOduration=1.462284311 podStartE2EDuration="4.37631428s" totalImagesPullingTime="2.914029969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:01.375900817 +0000 UTC m=+302.767156016" watchObservedRunningTime="2026-07-20 22:28:01.37631428 +0000 UTC m=+302.767569492"
Jul 20 22:28:05.456655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:05.456605    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:05.598986 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:05.598955    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:06.853934 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:06.853900    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:07.104170 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:07.104090    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:07.332425 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:07.332391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:10.350814 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:10.350782    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-cb4c45cc6-n6nhz"
Jul 20 22:28:10.681883 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:10.681803    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:10.933229 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:10.933150    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:11.248140 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:11.248054    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:12.279062 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:12.279031    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:12.459089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:12.459054    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:58.173638 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:58.173554    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:58.275446 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:58.275409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:58.405478 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:58.405441    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:59.205261 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:59.205223    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:28:59.343933 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:28:59.343896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:27.225220 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:27.225187    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:27.848713 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:27.848671    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:28.389489 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:28.389436    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:28.512186 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:28.512152    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:32.303437 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:32.303398    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:32.680638 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:32.680559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:32.951640 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:32.951557    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:35.392055 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:35.392020    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:35.849122 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:35.849081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:38.257323 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:38.257283    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:39.706136 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:39.706098    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:40.480893 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:40.480855    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:42.705323 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:42.705284    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:42.857565 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:42.857530    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:43.159767 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:43.159731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:43.286666 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:43.286626    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:43.847759 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:43.847724    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:44.012787 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:44.012742    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:44.155460 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:44.155365    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:45.160567 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:45.160524    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:45.414633 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:45.414548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:46.330340 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:46.330305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:46.454558 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:46.454521    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:47.266376 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:47.266338    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:47.408364 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:47.408334    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:48.659096 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:48.659059    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:49.550887 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:49.550847    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:49.662831 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:49.662798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:49.764308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:49.764279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:55.821512 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:55.821479    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:55.979966 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:55.979934    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:57.486090 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:57.486049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:57.594331 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:57.594300    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:29:59.455816 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.455787    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"]
Jul 20 22:29:59.457837 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.457812    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:29:59.461546 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.461523    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rmxj9\""
Jul 20 22:29:59.462009 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.461993    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 22:29:59.462293 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.462280    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 22:29:59.489378 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.489352    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"]
Jul 20 22:29:59.547157 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.547120    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/264d2ad0-e37d-4d9d-bf4b-194a7565033f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jc94l\" (UID: \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:29:59.547333 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.547233    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq89j\" (UniqueName: \"kubernetes.io/projected/264d2ad0-e37d-4d9d-bf4b-194a7565033f-kube-api-access-rq89j\") pod \"kuadrant-operator-controller-manager-86878c769f-jc94l\" (UID: \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:29:59.648433 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.648394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq89j\" (UniqueName: \"kubernetes.io/projected/264d2ad0-e37d-4d9d-bf4b-194a7565033f-kube-api-access-rq89j\") pod \"kuadrant-operator-controller-manager-86878c769f-jc94l\" (UID: \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:29:59.648618 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.648446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/264d2ad0-e37d-4d9d-bf4b-194a7565033f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jc94l\" (UID: \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:29:59.648879 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.648858    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/264d2ad0-e37d-4d9d-bf4b-194a7565033f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jc94l\" (UID: \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:29:59.661064 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.661042    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq89j\" (UniqueName: \"kubernetes.io/projected/264d2ad0-e37d-4d9d-bf4b-194a7565033f-kube-api-access-rq89j\") pod \"kuadrant-operator-controller-manager-86878c769f-jc94l\" (UID: \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:29:59.770778 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.770679    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:29:59.902045 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.902021    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"]
Jul 20 22:29:59.904463 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:29:59.904436    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264d2ad0_e37d_4d9d_bf4b_194a7565033f.slice/crio-3459fcb7db6a209710b81c819a4b3c0371620ab41a9aa552f7b03404f19c5eab WatchSource:0}: Error finding container 3459fcb7db6a209710b81c819a4b3c0371620ab41a9aa552f7b03404f19c5eab: Status 404 returned error can't find the container with id 3459fcb7db6a209710b81c819a4b3c0371620ab41a9aa552f7b03404f19c5eab
Jul 20 22:29:59.906672 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:29:59.906657    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:30:00.767599 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:00.767564    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l" event={"ID":"264d2ad0-e37d-4d9d-bf4b-194a7565033f","Type":"ContainerStarted","Data":"3459fcb7db6a209710b81c819a4b3c0371620ab41a9aa552f7b03404f19c5eab"}
Jul 20 22:30:00.996852 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:00.996811    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:01.102136 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:01.102107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:01.536128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:01.536036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:01.660728 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:01.660656    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:02.099821 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:02.099783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:02.208532 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:02.208491    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:04.785637 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:04.785546    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l" event={"ID":"264d2ad0-e37d-4d9d-bf4b-194a7565033f","Type":"ContainerStarted","Data":"fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334"}
Jul 20 22:30:04.786040 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:04.785719    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:30:04.810817 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:04.810768    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l" podStartSLOduration=1.294679226 podStartE2EDuration="5.810754637s" totalImagesPullingTime="4.516075411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:04.809652616 +0000 UTC m=+426.200907813" watchObservedRunningTime="2026-07-20 22:30:04.810754637 +0000 UTC m=+426.202009833"
Jul 20 22:30:05.537154 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:05.537116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:05.738564 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:05.738525    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:09.085134 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:09.085068    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:09.179492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:09.179458    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:14.745856 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:14.745822    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:14.843204 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:14.843167    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:15.792640 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:15.792603    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:30:32.307622 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:32.307532    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:32.837881 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:32.837850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:35.309511 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:35.309471    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:35.440398 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:35.440362    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:35.570979 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:35.570895    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:36.351636 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.351605    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:36.426316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.426283    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:36.438802 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.438778    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ff8sj"]
Jul 20 22:30:36.444885 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.444860    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ff8sj"
Jul 20 22:30:36.447409 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.447387    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-58qdt\""
Jul 20 22:30:36.453544 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.453521    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ff8sj"]
Jul 20 22:30:36.454213 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.454189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8wl\" (UniqueName: \"kubernetes.io/projected/a9f0273a-aeac-4f11-9e3a-a217fb80b98c-kube-api-access-gt8wl\") pod \"authorino-75d556bd77-ff8sj\" (UID: \"a9f0273a-aeac-4f11-9e3a-a217fb80b98c\") " pod="kuadrant-system/authorino-75d556bd77-ff8sj"
Jul 20 22:30:36.554550 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.554513    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8wl\" (UniqueName: \"kubernetes.io/projected/a9f0273a-aeac-4f11-9e3a-a217fb80b98c-kube-api-access-gt8wl\") pod \"authorino-75d556bd77-ff8sj\" (UID: \"a9f0273a-aeac-4f11-9e3a-a217fb80b98c\") " pod="kuadrant-system/authorino-75d556bd77-ff8sj"
Jul 20 22:30:36.563620 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.563590    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8wl\" (UniqueName: \"kubernetes.io/projected/a9f0273a-aeac-4f11-9e3a-a217fb80b98c-kube-api-access-gt8wl\") pod \"authorino-75d556bd77-ff8sj\" (UID: \"a9f0273a-aeac-4f11-9e3a-a217fb80b98c\") " pod="kuadrant-system/authorino-75d556bd77-ff8sj"
Jul 20 22:30:36.753318 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.753234    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ff8sj"
Jul 20 22:30:36.887095 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.887065    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ff8sj"]
Jul 20 22:30:36.889937 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:30:36.889912    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9f0273a_aeac_4f11_9e3a_a217fb80b98c.slice/crio-c89c026d834da8042d2e83aa5730b0de2cc49ea72c24c17ab360d4f1760747f0 WatchSource:0}: Error finding container c89c026d834da8042d2e83aa5730b0de2cc49ea72c24c17ab360d4f1760747f0: Status 404 returned error can't find the container with id c89c026d834da8042d2e83aa5730b0de2cc49ea72c24c17ab360d4f1760747f0
Jul 20 22:30:36.907569 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:36.907535    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ff8sj" event={"ID":"a9f0273a-aeac-4f11-9e3a-a217fb80b98c","Type":"ContainerStarted","Data":"c89c026d834da8042d2e83aa5730b0de2cc49ea72c24c17ab360d4f1760747f0"}
Jul 20 22:30:40.925626 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:40.925592    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ff8sj" event={"ID":"a9f0273a-aeac-4f11-9e3a-a217fb80b98c","Type":"ContainerStarted","Data":"395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98"}
Jul 20 22:30:40.953739 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:40.953670    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ff8sj" podStartSLOduration=1.954213636 podStartE2EDuration="4.953655364s" totalImagesPullingTime="2.999441728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:30:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:40.953636806 +0000 UTC m=+462.344892001" watchObservedRunningTime="2026-07-20 22:30:40.953655364 +0000 UTC m=+462.344910558"
Jul 20 22:30:51.468174 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:51.468136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:51.625645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:51.625606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:30:52.107923 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:30:52.107894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:04.722651 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:04.722613    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:07.748878 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:07.748845    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:09.081482 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.081445    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7747664876-z2qrg"]
Jul 20 22:31:09.087239 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.087218    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:31:09.089861 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.089839    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 22:31:09.098249 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.098223    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7747664876-z2qrg"]
Jul 20 22:31:09.214669 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.214641    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v66vb\" (UniqueName: \"kubernetes.io/projected/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-kube-api-access-v66vb\") pod \"authorino-7747664876-z2qrg\" (UID: \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\") " pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:31:09.214838 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.214683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-tls-cert\") pod \"authorino-7747664876-z2qrg\" (UID: \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\") " pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:31:09.315579 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.315546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-tls-cert\") pod \"authorino-7747664876-z2qrg\" (UID: \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\") " pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:31:09.315785 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.315681    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v66vb\" (UniqueName: \"kubernetes.io/projected/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-kube-api-access-v66vb\") pod \"authorino-7747664876-z2qrg\" (UID: \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\") " pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:31:09.317955 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.317935    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-tls-cert\") pod \"authorino-7747664876-z2qrg\" (UID: \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\") " pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:31:09.324941 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.324921    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v66vb\" (UniqueName: \"kubernetes.io/projected/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-kube-api-access-v66vb\") pod \"authorino-7747664876-z2qrg\" (UID: \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\") " pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:31:09.395680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.395606    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:31:09.544884 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:09.544860    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7747664876-z2qrg"]
Jul 20 22:31:09.546627 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:31:09.546598    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0bfea52_fda5_4d33_86ed_ff8c21b985c0.slice/crio-c9c7007d497f81ef0013a9355aa7994fa105af17ff70883408bce53291d5cbae WatchSource:0}: Error finding container c9c7007d497f81ef0013a9355aa7994fa105af17ff70883408bce53291d5cbae: Status 404 returned error can't find the container with id c9c7007d497f81ef0013a9355aa7994fa105af17ff70883408bce53291d5cbae
Jul 20 22:31:10.039065 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.039026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7747664876-z2qrg" event={"ID":"e0bfea52-fda5-4d33-86ed-ff8c21b985c0","Type":"ContainerStarted","Data":"5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3"}
Jul 20 22:31:10.039235 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.039080    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7747664876-z2qrg" event={"ID":"e0bfea52-fda5-4d33-86ed-ff8c21b985c0","Type":"ContainerStarted","Data":"c9c7007d497f81ef0013a9355aa7994fa105af17ff70883408bce53291d5cbae"}
Jul 20 22:31:10.055467 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.055417    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7747664876-z2qrg" podStartSLOduration=0.696924544 podStartE2EDuration="1.055397086s" totalImagesPullingTime="358.472542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:10.054138566 +0000 UTC m=+491.445393745" watchObservedRunningTime="2026-07-20 22:31:10.055397086 +0000 UTC m=+491.446652279"
Jul 20 22:31:10.079890 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.079835    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ff8sj"]
Jul 20 22:31:10.080070 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.080047    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ff8sj" podUID="a9f0273a-aeac-4f11-9e3a-a217fb80b98c" containerName="authorino" containerID="cri-o://395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98" gracePeriod=30
Jul 20 22:31:10.313531 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.313506    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ff8sj"
Jul 20 22:31:10.425161 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.425125    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt8wl\" (UniqueName: \"kubernetes.io/projected/a9f0273a-aeac-4f11-9e3a-a217fb80b98c-kube-api-access-gt8wl\") pod \"a9f0273a-aeac-4f11-9e3a-a217fb80b98c\" (UID: \"a9f0273a-aeac-4f11-9e3a-a217fb80b98c\") "
Jul 20 22:31:10.427217 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.427189    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f0273a-aeac-4f11-9e3a-a217fb80b98c-kube-api-access-gt8wl" (OuterVolumeSpecName: "kube-api-access-gt8wl") pod "a9f0273a-aeac-4f11-9e3a-a217fb80b98c" (UID: "a9f0273a-aeac-4f11-9e3a-a217fb80b98c"). InnerVolumeSpecName "kube-api-access-gt8wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:31:10.526121 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:10.526049    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt8wl\" (UniqueName: \"kubernetes.io/projected/a9f0273a-aeac-4f11-9e3a-a217fb80b98c-kube-api-access-gt8wl\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:31:11.043774 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.043739    2572 generic.go:356] "Generic (PLEG): container finished" podID="a9f0273a-aeac-4f11-9e3a-a217fb80b98c" containerID="395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98" exitCode=0
Jul 20 22:31:11.043963 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.043786    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ff8sj"
Jul 20 22:31:11.043963 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.043823    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ff8sj" event={"ID":"a9f0273a-aeac-4f11-9e3a-a217fb80b98c","Type":"ContainerDied","Data":"395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98"}
Jul 20 22:31:11.043963 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.043881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ff8sj" event={"ID":"a9f0273a-aeac-4f11-9e3a-a217fb80b98c","Type":"ContainerDied","Data":"c89c026d834da8042d2e83aa5730b0de2cc49ea72c24c17ab360d4f1760747f0"}
Jul 20 22:31:11.043963 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.043900    2572 scope.go:117] "RemoveContainer" containerID="395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98"
Jul 20 22:31:11.052864 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.052846    2572 scope.go:117] "RemoveContainer" containerID="395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98"
Jul 20 22:31:11.053125 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:31:11.053100    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98\": container with ID starting with 395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98 not found: ID does not exist" containerID="395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98"
Jul 20 22:31:11.053190 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.053134    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98"} err="failed to get container status \"395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98\": rpc error: code = NotFound desc = could not find container \"395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98\": container with ID starting with 395cea9176ef68f396297b74cb692587faaf363ea2c417c32992709787b22d98 not found: ID does not exist"
Jul 20 22:31:11.072541 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.072518    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ff8sj"]
Jul 20 22:31:11.077471 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.077453    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ff8sj"]
Jul 20 22:31:11.167849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:11.167811    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f0273a-aeac-4f11-9e3a-a217fb80b98c" path="/var/lib/kubelet/pods/a9f0273a-aeac-4f11-9e3a-a217fb80b98c/volumes"
Jul 20 22:31:14.935013 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:14.934977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:15.075048 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:15.075019    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:15.170726 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:15.170681    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:15.552012 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:15.551977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:18.471751 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:18.471716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:18.586749 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:18.586717    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:50.216383 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:50.216335    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:50.318959 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:50.318915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:50.869756 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:50.869653    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:50.967547 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:50.967490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:51.343912 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:51.343874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:31:51.496451 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:31:51.496415    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:32:00.666588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:00.666548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:32:00.767914 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:00.767882    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:32:10.346216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:10.346180    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:32:36.650087 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:36.650052    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:32:42.869660 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:42.869622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:32:53.510002 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.509966    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"]
Jul 20 22:32:53.510352 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.510282    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f0273a-aeac-4f11-9e3a-a217fb80b98c" containerName="authorino"
Jul 20 22:32:53.510352 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.510293    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f0273a-aeac-4f11-9e3a-a217fb80b98c" containerName="authorino"
Jul 20 22:32:53.510424 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.510355    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f0273a-aeac-4f11-9e3a-a217fb80b98c" containerName="authorino"
Jul 20 22:32:53.513081 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.513061    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.516461 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.516440    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 22:32:53.516676 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.516654    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 20 22:32:53.517089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.517072    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-brv49\""
Jul 20 22:32:53.517331 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.517316    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 22:32:53.525222 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.525199    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"]
Jul 20 22:32:53.556735 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.556679    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:32:53.557704 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.557669    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.557827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.557739    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.557827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.557770    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.557906 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.557824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.557906 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.557864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8v96\" (UniqueName: \"kubernetes.io/projected/93328ee8-de5a-4fbe-94bb-64d321d4396c-kube-api-access-b8v96\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.557971 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.557919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93328ee8-de5a-4fbe-94bb-64d321d4396c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659040 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.658998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659040 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.659038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659248 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.659057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659248 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.659085    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8v96\" (UniqueName: \"kubernetes.io/projected/93328ee8-de5a-4fbe-94bb-64d321d4396c-kube-api-access-b8v96\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659248 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.659117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93328ee8-de5a-4fbe-94bb-64d321d4396c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659369 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.659275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659534 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.659509    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659607 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.659538    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.659682 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.659659    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.661423 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.661404    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93328ee8-de5a-4fbe-94bb-64d321d4396c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.661669 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.661653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93328ee8-de5a-4fbe-94bb-64d321d4396c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.667551 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.667524    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8v96\" (UniqueName: \"kubernetes.io/projected/93328ee8-de5a-4fbe-94bb-64d321d4396c-kube-api-access-b8v96\") pod \"e2e-distinct-simulated-kserve-59975d69f9-k25dl\" (UID: \"93328ee8-de5a-4fbe-94bb-64d321d4396c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.823733 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.823678    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:32:53.951981 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:53.951948    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"]
Jul 20 22:32:53.954682 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:32:53.954653    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93328ee8_de5a_4fbe_94bb_64d321d4396c.slice/crio-672c78970c24bba684661c34179626db7fe7e3bc5f5c1085fdf596631c1e5925 WatchSource:0}: Error finding container 672c78970c24bba684661c34179626db7fe7e3bc5f5c1085fdf596631c1e5925: Status 404 returned error can't find the container with id 672c78970c24bba684661c34179626db7fe7e3bc5f5c1085fdf596631c1e5925
Jul 20 22:32:54.434743 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:54.434673    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl" event={"ID":"93328ee8-de5a-4fbe-94bb-64d321d4396c","Type":"ContainerStarted","Data":"672c78970c24bba684661c34179626db7fe7e3bc5f5c1085fdf596631c1e5925"}
Jul 20 22:32:55.440823 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:55.440739    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl" event={"ID":"93328ee8-de5a-4fbe-94bb-64d321d4396c","Type":"ContainerStarted","Data":"cc93fd9cdadade1dc3b10cbb0c7ce8f85cfcfde5cf0335204e7838f1ae6d9f80"}
Jul 20 22:32:55.460751 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:55.460670    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl" podStartSLOduration=1.35175292 podStartE2EDuration="2.460650882s" totalImagesPullingTime="1.108897962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:32:55.460344071 +0000 UTC m=+596.851599282" watchObservedRunningTime="2026-07-20 22:32:55.460650882 +0000 UTC m=+596.851906078"
Jul 20 22:32:59.796564 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:32:59.796527    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:00.878836 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:00.878793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:03.824330 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:03.824287    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:33:03.824744 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:03.824359    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:33:03.836927 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:03.836902    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:33:04.486176 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:04.486144    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-k25dl"
Jul 20 22:33:04.688833 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:04.688782    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:11.283985 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:11.283948    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:26.721844 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:26.721766    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:35.011530 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:35.011490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:35.094441 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:35.094403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:42.459474 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.459436    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"]
Jul 20 22:33:42.464136 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.464117    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.469730 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.469687    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 22:33:42.487362 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.487326    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"]
Jul 20 22:33:42.514915 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.514876    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:42.579644 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.579118    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.579644 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.579166    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.579644 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.579214    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwvt5\" (UniqueName: \"kubernetes.io/projected/ee9b5ddf-069a-450e-b868-0da954b09b59-kube-api-access-kwvt5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.579644 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.579262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9b5ddf-069a-450e-b868-0da954b09b59-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.579644 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.579286    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.579644 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.579312    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.680498 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.680458    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9b5ddf-069a-450e-b868-0da954b09b59-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.680498 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.680498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.680784 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.680520    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.680784 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.680564    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.680784 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.680582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.680784 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.680619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwvt5\" (UniqueName: \"kubernetes.io/projected/ee9b5ddf-069a-450e-b868-0da954b09b59-kube-api-access-kwvt5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.681018 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.680987    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.681125 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.681018    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.681125 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.681048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.682907 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.682879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee9b5ddf-069a-450e-b868-0da954b09b59-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.683078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.683060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9b5ddf-069a-450e-b868-0da954b09b59-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.688748 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.688720    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwvt5\" (UniqueName: \"kubernetes.io/projected/ee9b5ddf-069a-450e-b868-0da954b09b59-kube-api-access-kwvt5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb\" (UID: \"ee9b5ddf-069a-450e-b868-0da954b09b59\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.773393 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.773305    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:42.908604 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.908574    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"]
Jul 20 22:33:42.911317 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:33:42.911292    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee9b5ddf_069a_450e_b868_0da954b09b59.slice/crio-bb22951700752a1009057d0fecb3ee5e1301b40d2e3191b327d04f4d0ab48d3f WatchSource:0}: Error finding container bb22951700752a1009057d0fecb3ee5e1301b40d2e3191b327d04f4d0ab48d3f: Status 404 returned error can't find the container with id bb22951700752a1009057d0fecb3ee5e1301b40d2e3191b327d04f4d0ab48d3f
Jul 20 22:33:42.969645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:42.969608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:33:43.624820 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:43.624787    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb" event={"ID":"ee9b5ddf-069a-450e-b868-0da954b09b59","Type":"ContainerStarted","Data":"44995d66ae041aaa7eef76c4aa06807d64059305c8467796e32512d8b959429d"}
Jul 20 22:33:43.624820 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:43.624825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb" event={"ID":"ee9b5ddf-069a-450e-b868-0da954b09b59","Type":"ContainerStarted","Data":"bb22951700752a1009057d0fecb3ee5e1301b40d2e3191b327d04f4d0ab48d3f"}
Jul 20 22:33:43.649138 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:43.649084    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb" podStartSLOduration=1.480246091 podStartE2EDuration="1.649064406s" totalImagesPullingTime="168.818315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:33:43.646628441 +0000 UTC m=+645.037883639" watchObservedRunningTime="2026-07-20 22:33:43.649064406 +0000 UTC m=+645.040319602"
Jul 20 22:33:52.773655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:52.773616    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:52.774098 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:52.773675    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:52.786239 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:52.786214    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:33:53.676736 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:33:53.676684    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb"
Jul 20 22:34:18.980655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:18.980621    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:34:19.087394 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:19.087353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:34:20.143128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.143090    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:34:20.264836 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.264798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:34:20.512225 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.512146    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7747664876-z2qrg"]
Jul 20 22:34:20.512358 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.512327    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7747664876-z2qrg" podUID="e0bfea52-fda5-4d33-86ed-ff8c21b985c0" containerName="authorino" containerID="cri-o://5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3" gracePeriod=30
Jul 20 22:34:20.763636 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.763578    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:34:20.783756 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.783726    2572 generic.go:356] "Generic (PLEG): container finished" podID="e0bfea52-fda5-4d33-86ed-ff8c21b985c0" containerID="5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3" exitCode=0
Jul 20 22:34:20.783912 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.783765    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7747664876-z2qrg"
Jul 20 22:34:20.783912 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.783770    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7747664876-z2qrg" event={"ID":"e0bfea52-fda5-4d33-86ed-ff8c21b985c0","Type":"ContainerDied","Data":"5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3"}
Jul 20 22:34:20.783912 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.783799    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7747664876-z2qrg" event={"ID":"e0bfea52-fda5-4d33-86ed-ff8c21b985c0","Type":"ContainerDied","Data":"c9c7007d497f81ef0013a9355aa7994fa105af17ff70883408bce53291d5cbae"}
Jul 20 22:34:20.783912 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.783817    2572 scope.go:117] "RemoveContainer" containerID="5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3"
Jul 20 22:34:20.792344 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.792320    2572 scope.go:117] "RemoveContainer" containerID="5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3"
Jul 20 22:34:20.792688 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:34:20.792666    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3\": container with ID starting with 5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3 not found: ID does not exist" containerID="5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3"
Jul 20 22:34:20.792817 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.792711    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3"} err="failed to get container status \"5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3\": rpc error: code = NotFound desc = could not find container \"5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3\": container with ID starting with 5c5dae66939b74e8801dd90ce46acbda66e9bfa9508d312a941c79766dda48f3 not found: ID does not exist"
Jul 20 22:34:20.913367 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.913336    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v66vb\" (UniqueName: \"kubernetes.io/projected/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-kube-api-access-v66vb\") pod \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\" (UID: \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\") "
Jul 20 22:34:20.913367 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.913371    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-tls-cert\") pod \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\" (UID: \"e0bfea52-fda5-4d33-86ed-ff8c21b985c0\") "
Jul 20 22:34:20.915555 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.915522    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-kube-api-access-v66vb" (OuterVolumeSpecName: "kube-api-access-v66vb") pod "e0bfea52-fda5-4d33-86ed-ff8c21b985c0" (UID: "e0bfea52-fda5-4d33-86ed-ff8c21b985c0"). InnerVolumeSpecName "kube-api-access-v66vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:34:20.922134 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:20.922110    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e0bfea52-fda5-4d33-86ed-ff8c21b985c0" (UID: "e0bfea52-fda5-4d33-86ed-ff8c21b985c0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:34:21.024870 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:21.024798    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v66vb\" (UniqueName: \"kubernetes.io/projected/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-kube-api-access-v66vb\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:34:21.024870 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:21.024827    2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0bfea52-fda5-4d33-86ed-ff8c21b985c0-tls-cert\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:34:21.109244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:21.109214    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7747664876-z2qrg"]
Jul 20 22:34:21.113921 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:21.113898    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7747664876-z2qrg"]
Jul 20 22:34:21.169033 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:34:21.168997    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0bfea52-fda5-4d33-86ed-ff8c21b985c0" path="/var/lib/kubelet/pods/e0bfea52-fda5-4d33-86ed-ff8c21b985c0/volumes"
Jul 20 22:36:25.971790 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:36:25.971704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:36:27.163451 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:36:27.163395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:36:33.698483 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:36:33.698440    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:00.706300 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:00.706268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:00.805837 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:00.805802    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:00.928832 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:00.928793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:06.861450 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:06.861401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:06.965371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:06.965333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:07.062774 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:07.062741    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:07.270935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:07.270856    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:13.088077 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:13.088035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:37:13.157508 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:37:13.157463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:39:17.125385 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:39:17.125345    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:41:05.725500 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:05.725407    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"]
Jul 20 22:41:05.726063 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:05.725632    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l" podUID="264d2ad0-e37d-4d9d-bf4b-194a7565033f" containerName="manager" containerID="cri-o://fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334" gracePeriod=10
Jul 20 22:41:08.574439 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:08.574414    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:41:08.627569 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:08.627488    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/264d2ad0-e37d-4d9d-bf4b-194a7565033f-extensions-socket-volume\") pod \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\" (UID: \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\") "
Jul 20 22:41:08.627727 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:08.627574    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq89j\" (UniqueName: \"kubernetes.io/projected/264d2ad0-e37d-4d9d-bf4b-194a7565033f-kube-api-access-rq89j\") pod \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\" (UID: \"264d2ad0-e37d-4d9d-bf4b-194a7565033f\") "
Jul 20 22:41:08.627895 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:08.627877    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264d2ad0-e37d-4d9d-bf4b-194a7565033f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "264d2ad0-e37d-4d9d-bf4b-194a7565033f" (UID: "264d2ad0-e37d-4d9d-bf4b-194a7565033f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:41:08.629492 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:08.629462    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264d2ad0-e37d-4d9d-bf4b-194a7565033f-kube-api-access-rq89j" (OuterVolumeSpecName: "kube-api-access-rq89j") pod "264d2ad0-e37d-4d9d-bf4b-194a7565033f" (UID: "264d2ad0-e37d-4d9d-bf4b-194a7565033f"). InnerVolumeSpecName "kube-api-access-rq89j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:41:08.728529 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:08.728478    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/264d2ad0-e37d-4d9d-bf4b-194a7565033f-extensions-socket-volume\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:41:08.728529 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:08.728522    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq89j\" (UniqueName: \"kubernetes.io/projected/264d2ad0-e37d-4d9d-bf4b-194a7565033f-kube-api-access-rq89j\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:41:09.388396 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.388360    2572 generic.go:356] "Generic (PLEG): container finished" podID="264d2ad0-e37d-4d9d-bf4b-194a7565033f" containerID="fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334" exitCode=0
Jul 20 22:41:09.388548 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.388402    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"
Jul 20 22:41:09.388548 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.388407    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l" event={"ID":"264d2ad0-e37d-4d9d-bf4b-194a7565033f","Type":"ContainerDied","Data":"fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334"}
Jul 20 22:41:09.388548 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.388456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l" event={"ID":"264d2ad0-e37d-4d9d-bf4b-194a7565033f","Type":"ContainerDied","Data":"3459fcb7db6a209710b81c819a4b3c0371620ab41a9aa552f7b03404f19c5eab"}
Jul 20 22:41:09.388548 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.388478    2572 scope.go:117] "RemoveContainer" containerID="fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334"
Jul 20 22:41:09.397408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.397363    2572 scope.go:117] "RemoveContainer" containerID="fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334"
Jul 20 22:41:09.397652 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:41:09.397633    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334\": container with ID starting with fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334 not found: ID does not exist" containerID="fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334"
Jul 20 22:41:09.397730 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.397665    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334"} err="failed to get container status \"fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334\": rpc error: code = NotFound desc = could not find container \"fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334\": container with ID starting with fd25fe50dd181a7396c0f957334bc059807492d5665966a4ff82923eca19d334 not found: ID does not exist"
Jul 20 22:41:09.407661 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.407637    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"]
Jul 20 22:41:09.413844 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:09.413827    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jc94l"]
Jul 20 22:41:11.167793 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:11.167760    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264d2ad0-e37d-4d9d-bf4b-194a7565033f" path="/var/lib/kubelet/pods/264d2ad0-e37d-4d9d-bf4b-194a7565033f/volumes"
Jul 20 22:41:24.207232 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:41:24.207199    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:42:05.114010 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:05.113977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:42:05.170965 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:05.170931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:42:06.909895 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.909860    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"]
Jul 20 22:42:06.910251 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.910137    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264d2ad0-e37d-4d9d-bf4b-194a7565033f" containerName="manager"
Jul 20 22:42:06.910251 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.910147    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="264d2ad0-e37d-4d9d-bf4b-194a7565033f" containerName="manager"
Jul 20 22:42:06.910251 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.910158    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0bfea52-fda5-4d33-86ed-ff8c21b985c0" containerName="authorino"
Jul 20 22:42:06.910251 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.910163    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0bfea52-fda5-4d33-86ed-ff8c21b985c0" containerName="authorino"
Jul 20 22:42:06.910251 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.910211    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0bfea52-fda5-4d33-86ed-ff8c21b985c0" containerName="authorino"
Jul 20 22:42:06.910251 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.910218    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="264d2ad0-e37d-4d9d-bf4b-194a7565033f" containerName="manager"
Jul 20 22:42:06.914233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.914216    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:06.917001 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.916977    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 22:42:06.917130 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.917034    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rmxj9\""
Jul 20 22:42:06.917412 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.917397    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 22:42:06.932129 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.932103    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"]
Jul 20 22:42:06.962659 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.962627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmgg\" (UniqueName: \"kubernetes.io/projected/c291deb2-d074-419d-8835-60eb26b46f19-kube-api-access-jtmgg\") pod \"kuadrant-operator-controller-manager-86878c769f-qdtbl\" (UID: \"c291deb2-d074-419d-8835-60eb26b46f19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:06.962827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:06.962711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c291deb2-d074-419d-8835-60eb26b46f19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qdtbl\" (UID: \"c291deb2-d074-419d-8835-60eb26b46f19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:07.063684 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.063644    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c291deb2-d074-419d-8835-60eb26b46f19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qdtbl\" (UID: \"c291deb2-d074-419d-8835-60eb26b46f19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:07.063895 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.063748    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmgg\" (UniqueName: \"kubernetes.io/projected/c291deb2-d074-419d-8835-60eb26b46f19-kube-api-access-jtmgg\") pod \"kuadrant-operator-controller-manager-86878c769f-qdtbl\" (UID: \"c291deb2-d074-419d-8835-60eb26b46f19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:07.064060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.064038    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c291deb2-d074-419d-8835-60eb26b46f19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qdtbl\" (UID: \"c291deb2-d074-419d-8835-60eb26b46f19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:07.073723 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.073684    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmgg\" (UniqueName: \"kubernetes.io/projected/c291deb2-d074-419d-8835-60eb26b46f19-kube-api-access-jtmgg\") pod \"kuadrant-operator-controller-manager-86878c769f-qdtbl\" (UID: \"c291deb2-d074-419d-8835-60eb26b46f19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:07.224300 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.224218    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:07.362733 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.362689    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"]
Jul 20 22:42:07.366848 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:42:07.366810    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc291deb2_d074_419d_8835_60eb26b46f19.slice/crio-a83d722bab2723c0c5d5c116ee9ae4e34d850238a5e3e28806924ba67e3ba903 WatchSource:0}: Error finding container a83d722bab2723c0c5d5c116ee9ae4e34d850238a5e3e28806924ba67e3ba903: Status 404 returned error can't find the container with id a83d722bab2723c0c5d5c116ee9ae4e34d850238a5e3e28806924ba67e3ba903
Jul 20 22:42:07.616374 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.616340    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl" event={"ID":"c291deb2-d074-419d-8835-60eb26b46f19","Type":"ContainerStarted","Data":"14026e6e344da559b944fe6d172fe5019fc321839f4074a1d4b088382f927821"}
Jul 20 22:42:07.616542 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.616395    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl" event={"ID":"c291deb2-d074-419d-8835-60eb26b46f19","Type":"ContainerStarted","Data":"a83d722bab2723c0c5d5c116ee9ae4e34d850238a5e3e28806924ba67e3ba903"}
Jul 20 22:42:07.616542 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.616425    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:42:07.638684 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:07.638635    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl" podStartSLOduration=1.6386213490000001 podStartE2EDuration="1.638621349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:42:07.637326342 +0000 UTC m=+1149.028581538" watchObservedRunningTime="2026-07-20 22:42:07.638621349 +0000 UTC m=+1149.029876543"
Jul 20 22:42:18.623526 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:42:18.623492    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdtbl"
Jul 20 22:45:00.152161 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:00.152123    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx"]
Jul 20 22:45:00.155594 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:00.155579    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx"
Jul 20 22:45:00.158173 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:00.158152    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 22:45:00.164113 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:00.164093    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx"
Jul 20 22:45:00.183325 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:00.183277    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx"]
Jul 20 22:45:00.293056 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:00.293028    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx"]
Jul 20 22:45:00.296081 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:45:00.296054    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476c74e5_ba73_4eda_802a_4bdab93539ac.slice/crio-c611597c371cc316c7c0e14eb1be7eee8122e8eaf279b0bdc134b1de4e4c32e7 WatchSource:0}: Error finding container c611597c371cc316c7c0e14eb1be7eee8122e8eaf279b0bdc134b1de4e4c32e7: Status 404 returned error can't find the container with id c611597c371cc316c7c0e14eb1be7eee8122e8eaf279b0bdc134b1de4e4c32e7
Jul 20 22:45:00.298014 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:00.297996    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:45:01.295134 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:01.295102    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx" event={"ID":"476c74e5-ba73-4eda-802a-4bdab93539ac","Type":"ContainerStarted","Data":"c611597c371cc316c7c0e14eb1be7eee8122e8eaf279b0bdc134b1de4e4c32e7"}
Jul 20 22:45:03.306436 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.306400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx" event={"ID":"476c74e5-ba73-4eda-802a-4bdab93539ac","Type":"ContainerStarted","Data":"6fe8a385014916e548c20142eadccec456ffedbc1e0026c2d06e4546829d0403"}
Jul 20 22:45:03.324247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.324199    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx" podStartSLOduration=0.996063787 podStartE2EDuration="3.324184551s" totalImagesPullingTime="2.328120764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:45:03.322863546 +0000 UTC m=+1324.714118743" watchObservedRunningTime="2026-07-20 22:45:03.324184551 +0000 UTC m=+1324.715439745"
Jul 20 22:45:03.750988 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.750954    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"]
Jul 20 22:45:03.753666 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.753652    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.758877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.758855    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-644e2889-kserve-self-signed-certs\""
Jul 20 22:45:03.831065 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.830974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-model-cache\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.831065 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.831018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-tmp-dir\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.831255 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.831075    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cfdf29-4840-4cda-8b53-b915cb5af097-tls-certs\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.831255 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.831120    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw8rn\" (UniqueName: \"kubernetes.io/projected/54cfdf29-4840-4cda-8b53-b915cb5af097-kube-api-access-zw8rn\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.831255 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.831148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-dshm\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.831255 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.831210    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-home\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.836652 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.836627    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"]
Jul 20 22:45:03.931937 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.931898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw8rn\" (UniqueName: \"kubernetes.io/projected/54cfdf29-4840-4cda-8b53-b915cb5af097-kube-api-access-zw8rn\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.931937 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.931938    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-dshm\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.932163 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.931973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-home\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.932163 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.932006    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-model-cache\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.932163 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.932025    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-tmp-dir\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.932163 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.932042    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cfdf29-4840-4cda-8b53-b915cb5af097-tls-certs\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.932378 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.932359    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-home\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.932436 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.932394    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-tmp-dir\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.932568 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.932549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-model-cache\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.934267 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.934238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-dshm\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.934643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.934627    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cfdf29-4840-4cda-8b53-b915cb5af097-tls-certs\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.951555 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.951523    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw8rn\" (UniqueName: \"kubernetes.io/projected/54cfdf29-4840-4cda-8b53-b915cb5af097-kube-api-access-zw8rn\") pod \"e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") " pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:03.996038 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:03.996000    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:45:04.062648 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:04.062616    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:04.199187 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:04.199127    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"]
Jul 20 22:45:04.201211 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:45:04.201185    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54cfdf29_4840_4cda_8b53_b915cb5af097.slice/crio-f377df37916c9e829e104e1f004113dacb9146368b22540a34e537247ee4957b WatchSource:0}: Error finding container f377df37916c9e829e104e1f004113dacb9146368b22540a34e537247ee4957b: Status 404 returned error can't find the container with id f377df37916c9e829e104e1f004113dacb9146368b22540a34e537247ee4957b
Jul 20 22:45:04.311858 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:04.311811    2572 generic.go:356] "Generic (PLEG): container finished" podID="476c74e5-ba73-4eda-802a-4bdab93539ac" containerID="6fe8a385014916e548c20142eadccec456ffedbc1e0026c2d06e4546829d0403" exitCode=0
Jul 20 22:45:04.312231 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:04.311894    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx" event={"ID":"476c74e5-ba73-4eda-802a-4bdab93539ac","Type":"ContainerDied","Data":"6fe8a385014916e548c20142eadccec456ffedbc1e0026c2d06e4546829d0403"}
Jul 20 22:45:04.313291 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:04.313268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr" event={"ID":"54cfdf29-4840-4cda-8b53-b915cb5af097","Type":"ContainerStarted","Data":"7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523"}
Jul 20 22:45:04.313291 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:04.313301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr" event={"ID":"54cfdf29-4840-4cda-8b53-b915cb5af097","Type":"ContainerStarted","Data":"f377df37916c9e829e104e1f004113dacb9146368b22540a34e537247ee4957b"}
Jul 20 22:45:04.356794 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:04.356744    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr" podStartSLOduration=1.356726517 podStartE2EDuration="1.356726517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:45:04.35592873 +0000 UTC m=+1325.747183925" watchObservedRunningTime="2026-07-20 22:45:04.356726517 +0000 UTC m=+1325.747981711"
Jul 20 22:45:05.441960 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:05.441936    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx"
Jul 20 22:45:06.322455 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:06.322418    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx" event={"ID":"476c74e5-ba73-4eda-802a-4bdab93539ac","Type":"ContainerDied","Data":"c611597c371cc316c7c0e14eb1be7eee8122e8eaf279b0bdc134b1de4e4c32e7"}
Jul 20 22:45:06.322455 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:06.322440    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743125-rtwhx"
Jul 20 22:45:06.322655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:06.322478    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c611597c371cc316c7c0e14eb1be7eee8122e8eaf279b0bdc134b1de4e4c32e7"
Jul 20 22:45:14.062960 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:14.062918    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:14.063444 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:14.063182    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:14.076002 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:14.075976    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:14.364843 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:14.364765    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:18.247276 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.247239    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"]
Jul 20 22:45:18.247655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.247531    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="476c74e5-ba73-4eda-802a-4bdab93539ac" containerName="cleanup"
Jul 20 22:45:18.247655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.247541    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="476c74e5-ba73-4eda-802a-4bdab93539ac" containerName="cleanup"
Jul 20 22:45:18.247655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.247597    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="476c74e5-ba73-4eda-802a-4bdab93539ac" containerName="cleanup"
Jul 20 22:45:18.250444 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.250423    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.255713 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.255684    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-644e2889-kserve-self-signed-certs\""
Jul 20 22:45:18.295964 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.295931    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"]
Jul 20 22:45:18.357128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.357095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-tmp-dir\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.357337 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.357149    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-dshm\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.357337 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.357185    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-home\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.357337 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.357257    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crh8w\" (UniqueName: \"kubernetes.io/projected/f9471379-c174-4f74-b001-110100dcd2da-kube-api-access-crh8w\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.357337 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.357286    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-model-cache\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.357476 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.357372    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9471379-c174-4f74-b001-110100dcd2da-tls-certs\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.381655 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.381627    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:45:18.458002 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.457964    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9471379-c174-4f74-b001-110100dcd2da-tls-certs\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.458166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.458014    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-tmp-dir\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.458166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.458054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-dshm\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.458166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.458077    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-home\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.458308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.458226    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crh8w\" (UniqueName: \"kubernetes.io/projected/f9471379-c174-4f74-b001-110100dcd2da-kube-api-access-crh8w\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.458308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.458260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-model-cache\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.458490 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.458470    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-tmp-dir\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.458551 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.458505    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-home\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.458615 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.458597    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-model-cache\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.460302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.460281    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-dshm\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.460456 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.460441    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9471379-c174-4f74-b001-110100dcd2da-tls-certs\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.469184 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.469162    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crh8w\" (UniqueName: \"kubernetes.io/projected/f9471379-c174-4f74-b001-110100dcd2da-kube-api-access-crh8w\") pod \"e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") " pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.559002 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.558970    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:18.692177 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:18.692144    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"]
Jul 20 22:45:18.695013 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:45:18.694973    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9471379_c174_4f74_b001_110100dcd2da.slice/crio-00847cb5aa40b965ae4fe022fc5a8e3e8611f05fce7302f9f233af14c9844918 WatchSource:0}: Error finding container 00847cb5aa40b965ae4fe022fc5a8e3e8611f05fce7302f9f233af14c9844918: Status 404 returned error can't find the container with id 00847cb5aa40b965ae4fe022fc5a8e3e8611f05fce7302f9f233af14c9844918
Jul 20 22:45:19.376223 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:19.376179    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs" event={"ID":"f9471379-c174-4f74-b001-110100dcd2da","Type":"ContainerStarted","Data":"85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb"}
Jul 20 22:45:19.376223 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:19.376229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs" event={"ID":"f9471379-c174-4f74-b001-110100dcd2da","Type":"ContainerStarted","Data":"00847cb5aa40b965ae4fe022fc5a8e3e8611f05fce7302f9f233af14c9844918"}
Jul 20 22:45:19.399128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:19.399079    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs" podStartSLOduration=1.3990638579999999 podStartE2EDuration="1.399063858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:45:19.39820247 +0000 UTC m=+1340.789457665" watchObservedRunningTime="2026-07-20 22:45:19.399063858 +0000 UTC m=+1340.790319052"
Jul 20 22:45:23.292901 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:23.292814    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:45:23.371466 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:23.371425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:45:28.559687 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:28.559652    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:28.559687 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:28.559715    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:28.571837 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:28.571798    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:29.428916 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:29.428886    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:40.691967 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:40.691933    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"]
Jul 20 22:45:40.717228 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:40.717196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:45:42.412669 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:42.412637    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"]
Jul 20 22:45:42.450601 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:42.450570    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:45:55.711005 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.710937    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr" podUID="54cfdf29-4840-4cda-8b53-b915cb5af097" containerName="main" containerID="cri-o://7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523" gracePeriod=45
Jul 20 22:45:55.950668 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.950642    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:55.984844 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.984771    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-tmp-dir\") pod \"54cfdf29-4840-4cda-8b53-b915cb5af097\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") "
Jul 20 22:45:55.984844 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.984829    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-home\") pod \"54cfdf29-4840-4cda-8b53-b915cb5af097\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") "
Jul 20 22:45:55.985058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.984873    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-model-cache\") pod \"54cfdf29-4840-4cda-8b53-b915cb5af097\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") "
Jul 20 22:45:55.985058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.984911    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-dshm\") pod \"54cfdf29-4840-4cda-8b53-b915cb5af097\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") "
Jul 20 22:45:55.985058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.984941    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw8rn\" (UniqueName: \"kubernetes.io/projected/54cfdf29-4840-4cda-8b53-b915cb5af097-kube-api-access-zw8rn\") pod \"54cfdf29-4840-4cda-8b53-b915cb5af097\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") "
Jul 20 22:45:55.985058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.984970    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cfdf29-4840-4cda-8b53-b915cb5af097-tls-certs\") pod \"54cfdf29-4840-4cda-8b53-b915cb5af097\" (UID: \"54cfdf29-4840-4cda-8b53-b915cb5af097\") "
Jul 20 22:45:55.985240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.985102    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-home" (OuterVolumeSpecName: "home") pod "54cfdf29-4840-4cda-8b53-b915cb5af097" (UID: "54cfdf29-4840-4cda-8b53-b915cb5af097"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:45:55.985240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.985148    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "54cfdf29-4840-4cda-8b53-b915cb5af097" (UID: "54cfdf29-4840-4cda-8b53-b915cb5af097"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:45:55.985240 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.985232    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-tmp-dir\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:55.985376 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.985243    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-home\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:55.985376 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.985348    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-model-cache" (OuterVolumeSpecName: "model-cache") pod "54cfdf29-4840-4cda-8b53-b915cb5af097" (UID: "54cfdf29-4840-4cda-8b53-b915cb5af097"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:45:55.987458 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.987427    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cfdf29-4840-4cda-8b53-b915cb5af097-kube-api-access-zw8rn" (OuterVolumeSpecName: "kube-api-access-zw8rn") pod "54cfdf29-4840-4cda-8b53-b915cb5af097" (UID: "54cfdf29-4840-4cda-8b53-b915cb5af097"). InnerVolumeSpecName "kube-api-access-zw8rn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:45:55.987587 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.987495    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54cfdf29-4840-4cda-8b53-b915cb5af097-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "54cfdf29-4840-4cda-8b53-b915cb5af097" (UID: "54cfdf29-4840-4cda-8b53-b915cb5af097"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:45:55.987587 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:55.987560    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-dshm" (OuterVolumeSpecName: "dshm") pod "54cfdf29-4840-4cda-8b53-b915cb5af097" (UID: "54cfdf29-4840-4cda-8b53-b915cb5af097"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:45:56.086182 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.086144    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-model-cache\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:56.086182 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.086173    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cfdf29-4840-4cda-8b53-b915cb5af097-dshm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:56.086182 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.086182    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw8rn\" (UniqueName: \"kubernetes.io/projected/54cfdf29-4840-4cda-8b53-b915cb5af097-kube-api-access-zw8rn\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:56.086394 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.086191    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cfdf29-4840-4cda-8b53-b915cb5af097-tls-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:56.525730 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.525674    2572 generic.go:356] "Generic (PLEG): container finished" podID="54cfdf29-4840-4cda-8b53-b915cb5af097" containerID="7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523" exitCode=0
Jul 20 22:45:56.525893 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.525742    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"
Jul 20 22:45:56.525893 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.525764    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr" event={"ID":"54cfdf29-4840-4cda-8b53-b915cb5af097","Type":"ContainerDied","Data":"7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523"}
Jul 20 22:45:56.525893 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.525801    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr" event={"ID":"54cfdf29-4840-4cda-8b53-b915cb5af097","Type":"ContainerDied","Data":"f377df37916c9e829e104e1f004113dacb9146368b22540a34e537247ee4957b"}
Jul 20 22:45:56.525893 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.525823    2572 scope.go:117] "RemoveContainer" containerID="7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523"
Jul 20 22:45:56.534612 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.534594    2572 scope.go:117] "RemoveContainer" containerID="7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523"
Jul 20 22:45:56.534855 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:45:56.534837    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523\": container with ID starting with 7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523 not found: ID does not exist" containerID="7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523"
Jul 20 22:45:56.534908 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.534867    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523"} err="failed to get container status \"7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523\": rpc error: code = NotFound desc = could not find container \"7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523\": container with ID starting with 7fa89f540d71d775e5f4a6ed34b37d594aa2ba7b3ea5ece4061d661e4582b523 not found: ID does not exist"
Jul 20 22:45:56.547921 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.547896    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"]
Jul 20 22:45:56.550946 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:56.550924    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-644e2889-kserve-5bc7ffc9f9-66hrr"]
Jul 20 22:45:57.169445 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.169409    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54cfdf29-4840-4cda-8b53-b915cb5af097" path="/var/lib/kubelet/pods/54cfdf29-4840-4cda-8b53-b915cb5af097/volumes"
Jul 20 22:45:57.431465 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.431373    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs" podUID="f9471379-c174-4f74-b001-110100dcd2da" containerName="main" containerID="cri-o://85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb" gracePeriod=45
Jul 20 22:45:57.676622 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.676589    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:57.802365 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802341    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-tmp-dir\") pod \"f9471379-c174-4f74-b001-110100dcd2da\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") "
Jul 20 22:45:57.802500 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802405    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-model-cache\") pod \"f9471379-c174-4f74-b001-110100dcd2da\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") "
Jul 20 22:45:57.802500 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802437    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crh8w\" (UniqueName: \"kubernetes.io/projected/f9471379-c174-4f74-b001-110100dcd2da-kube-api-access-crh8w\") pod \"f9471379-c174-4f74-b001-110100dcd2da\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") "
Jul 20 22:45:57.802500 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802459    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-home\") pod \"f9471379-c174-4f74-b001-110100dcd2da\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") "
Jul 20 22:45:57.802500 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802482    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9471379-c174-4f74-b001-110100dcd2da-tls-certs\") pod \"f9471379-c174-4f74-b001-110100dcd2da\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") "
Jul 20 22:45:57.802663 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802520    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-dshm\") pod \"f9471379-c174-4f74-b001-110100dcd2da\" (UID: \"f9471379-c174-4f74-b001-110100dcd2da\") "
Jul 20 22:45:57.802737 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802657    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f9471379-c174-4f74-b001-110100dcd2da" (UID: "f9471379-c174-4f74-b001-110100dcd2da"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:45:57.802737 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802667    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-model-cache" (OuterVolumeSpecName: "model-cache") pod "f9471379-c174-4f74-b001-110100dcd2da" (UID: "f9471379-c174-4f74-b001-110100dcd2da"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:45:57.802849 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.802791    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-home" (OuterVolumeSpecName: "home") pod "f9471379-c174-4f74-b001-110100dcd2da" (UID: "f9471379-c174-4f74-b001-110100dcd2da"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:45:57.804680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.804644    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-dshm" (OuterVolumeSpecName: "dshm") pod "f9471379-c174-4f74-b001-110100dcd2da" (UID: "f9471379-c174-4f74-b001-110100dcd2da"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:45:57.804680 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.804654    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9471379-c174-4f74-b001-110100dcd2da-kube-api-access-crh8w" (OuterVolumeSpecName: "kube-api-access-crh8w") pod "f9471379-c174-4f74-b001-110100dcd2da" (UID: "f9471379-c174-4f74-b001-110100dcd2da"). InnerVolumeSpecName "kube-api-access-crh8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:45:57.804844 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.804748    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9471379-c174-4f74-b001-110100dcd2da-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f9471379-c174-4f74-b001-110100dcd2da" (UID: "f9471379-c174-4f74-b001-110100dcd2da"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:45:57.903368 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.903331    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-dshm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:57.903368 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.903359    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-tmp-dir\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:57.903368 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.903368    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-model-cache\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:57.903575 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.903378    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crh8w\" (UniqueName: \"kubernetes.io/projected/f9471379-c174-4f74-b001-110100dcd2da-kube-api-access-crh8w\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:57.903575 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.903388    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9471379-c174-4f74-b001-110100dcd2da-home\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:57.903575 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:57.903395    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9471379-c174-4f74-b001-110100dcd2da-tls-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:45:58.540773 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.540734    2572 generic.go:356] "Generic (PLEG): container finished" podID="f9471379-c174-4f74-b001-110100dcd2da" containerID="85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb" exitCode=0
Jul 20 22:45:58.541184 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.540780    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"
Jul 20 22:45:58.541184 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.540817    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs" event={"ID":"f9471379-c174-4f74-b001-110100dcd2da","Type":"ContainerDied","Data":"85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb"}
Jul 20 22:45:58.541184 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.540863    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs" event={"ID":"f9471379-c174-4f74-b001-110100dcd2da","Type":"ContainerDied","Data":"00847cb5aa40b965ae4fe022fc5a8e3e8611f05fce7302f9f233af14c9844918"}
Jul 20 22:45:58.541184 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.540879    2572 scope.go:117] "RemoveContainer" containerID="85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb"
Jul 20 22:45:58.549136 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.549112    2572 scope.go:117] "RemoveContainer" containerID="85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb"
Jul 20 22:45:58.549392 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:45:58.549375    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb\": container with ID starting with 85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb not found: ID does not exist" containerID="85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb"
Jul 20 22:45:58.549440 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.549402    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb"} err="failed to get container status \"85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb\": rpc error: code = NotFound desc = could not find container \"85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb\": container with ID starting with 85d7bee23ad3d509077b109bffb399bc819d4d221247bd8406f937f002deadfb not found: ID does not exist"
Jul 20 22:45:58.562179 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.562149    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"]
Jul 20 22:45:58.565375 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:58.565356    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-644e2889-kserve-846dc4d7b7-kk7vs"]
Jul 20 22:45:59.168603 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:45:59.168574    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9471379-c174-4f74-b001-110100dcd2da" path="/var/lib/kubelet/pods/f9471379-c174-4f74-b001-110100dcd2da/volumes"
Jul 20 22:47:50.289512 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:47:50.289478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:48:44.599062 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:48:44.598973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:48:52.732189 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:48:52.732151    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:48:53.921802 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:48:53.921772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:48:54.021667 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:48:54.021626    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:00.989137 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:00.989099    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:06.242129 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:06.242095    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:09.142409 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:09.142378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:09.236727 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:09.236676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:09.616683 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:09.616647    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:15.920228 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:15.920194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:16.014439 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:16.014408    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:16.223373 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:16.223278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:16.591338 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:16.591303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:16.720646 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:16.720596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:18.776330 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.776294    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:18.869896 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.869865    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"]
Jul 20 22:49:18.870185 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.870172    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9471379-c174-4f74-b001-110100dcd2da" containerName="main"
Jul 20 22:49:18.870230 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.870187    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9471379-c174-4f74-b001-110100dcd2da" containerName="main"
Jul 20 22:49:18.870230 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.870197    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cfdf29-4840-4cda-8b53-b915cb5af097" containerName="main"
Jul 20 22:49:18.870230 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.870203    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cfdf29-4840-4cda-8b53-b915cb5af097" containerName="main"
Jul 20 22:49:18.870316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.870264    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9471379-c174-4f74-b001-110100dcd2da" containerName="main"
Jul 20 22:49:18.870316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.870273    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="54cfdf29-4840-4cda-8b53-b915cb5af097" containerName="main"
Jul 20 22:49:18.873243 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.873227    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:18.875707 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.875658    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0c1ccb75-serving-cert\""
Jul 20 22:49:18.875824 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.875775    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 22:49:18.876622 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.876607    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 22:49:18.876718 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.876703    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:49:18.896488 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.896455    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"]
Jul 20 22:49:18.906158 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.906128    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:18.906308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.906161    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f96c569-5726-45ff-91b5-40fdcc045844-openshift-service-ca\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:18.906308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.906263    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p62h\" (UniqueName: \"kubernetes.io/projected/5f96c569-5726-45ff-91b5-40fdcc045844-kube-api-access-7p62h\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:18.915006 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:18.914964    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:19.007203 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.007166    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p62h\" (UniqueName: \"kubernetes.io/projected/5f96c569-5726-45ff-91b5-40fdcc045844-kube-api-access-7p62h\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:19.007407 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.007217    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:19.007407 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.007235    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f96c569-5726-45ff-91b5-40fdcc045844-openshift-service-ca\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:19.007407 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:49:19.007328    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-serving-cert: secret "maas-api-e2e-ait-0c1ccb75-serving-cert" not found
Jul 20 22:49:19.007407 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:49:19.007401    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls podName:5f96c569-5726-45ff-91b5-40fdcc045844 nodeName:}" failed. No retries permitted until 2026-07-20 22:49:19.507383455 +0000 UTC m=+1580.898638632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls") pod "maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn" (UID: "5f96c569-5726-45ff-91b5-40fdcc045844") : secret "maas-api-e2e-ait-0c1ccb75-serving-cert" not found
Jul 20 22:49:19.007891 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.007855    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f96c569-5726-45ff-91b5-40fdcc045844-openshift-service-ca\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:19.009009 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.008975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:19.022653 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.022621    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p62h\" (UniqueName: \"kubernetes.io/projected/5f96c569-5726-45ff-91b5-40fdcc045844-kube-api-access-7p62h\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:19.392951 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.392919    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:19.512160 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.512117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:19.514441 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.514412    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls\") pod \"maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:19.520080 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.520040    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:19.620408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.620373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:19.783333 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.783247    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:19.911809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:19.911777    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"]
Jul 20 22:49:19.914298 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:49:19.914272    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f96c569_5726_45ff_91b5_40fdcc045844.slice/crio-ea893b8616ce9e5be7906c860fd91101deed9f97a76a2fcdc781c9cfb2f70426 WatchSource:0}: Error finding container ea893b8616ce9e5be7906c860fd91101deed9f97a76a2fcdc781c9cfb2f70426: Status 404 returned error can't find the container with id ea893b8616ce9e5be7906c860fd91101deed9f97a76a2fcdc781c9cfb2f70426
Jul 20 22:49:20.350209 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:20.350156    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn" event={"ID":"5f96c569-5726-45ff-91b5-40fdcc045844","Type":"ContainerStarted","Data":"ea893b8616ce9e5be7906c860fd91101deed9f97a76a2fcdc781c9cfb2f70426"}
Jul 20 22:49:22.359413 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:22.359322    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn" event={"ID":"5f96c569-5726-45ff-91b5-40fdcc045844","Type":"ContainerStarted","Data":"b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf"}
Jul 20 22:49:22.359413 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:22.359386    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:22.380799 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:22.380735    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn" podStartSLOduration=2.242233031 podStartE2EDuration="4.380711149s" totalImagesPullingTime="2.138478118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:49:22.378187576 +0000 UTC m=+1583.769442773" watchObservedRunningTime="2026-07-20 22:49:22.380711149 +0000 UTC m=+1583.771966337"
Jul 20 22:49:24.300164 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:24.300127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:28.369591 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:28.369561    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:44.298107 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.298070    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"]
Jul 20 22:49:44.301282 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.301266    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"
Jul 20 22:49:44.304474 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.304447    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 22:49:44.315153 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.315128    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"]
Jul 20 22:49:44.427743 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.427683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7328ba40-c6ad-44f0-a110-efdfac50b7d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd\" (UID: \"7328ba40-c6ad-44f0-a110-efdfac50b7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"
Jul 20 22:49:44.528150 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.528113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7328ba40-c6ad-44f0-a110-efdfac50b7d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd\" (UID: \"7328ba40-c6ad-44f0-a110-efdfac50b7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"
Jul 20 22:49:44.528744 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.528723    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7328ba40-c6ad-44f0-a110-efdfac50b7d9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd\" (UID: \"7328ba40-c6ad-44f0-a110-efdfac50b7d9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"
Jul 20 22:49:44.610486 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.610455    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"
Jul 20 22:49:44.738485 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:44.738455    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"]
Jul 20 22:49:44.740585 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:49:44.740559    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7328ba40_c6ad_44f0_a110_efdfac50b7d9.slice/crio-ef92d01ae2c2cda3c734c1b670d67da51399192051bf84020daadf1d555a80b6 WatchSource:0}: Error finding container ef92d01ae2c2cda3c734c1b670d67da51399192051bf84020daadf1d555a80b6: Status 404 returned error can't find the container with id ef92d01ae2c2cda3c734c1b670d67da51399192051bf84020daadf1d555a80b6
Jul 20 22:49:45.451003 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:45.450954    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd" event={"ID":"7328ba40-c6ad-44f0-a110-efdfac50b7d9","Type":"ContainerStarted","Data":"5a658b30183d4dca94299e43cf5d147e89c6ebf47d12e2cc66030bdf5e3ec361"}
Jul 20 22:49:45.451387 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:45.451026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd" event={"ID":"7328ba40-c6ad-44f0-a110-efdfac50b7d9","Type":"ContainerStarted","Data":"ef92d01ae2c2cda3c734c1b670d67da51399192051bf84020daadf1d555a80b6"}
Jul 20 22:49:45.468281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:45.468231    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd" podStartSLOduration=1.468216883 podStartE2EDuration="1.468216883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:49:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:49:45.466961572 +0000 UTC m=+1606.858216767" watchObservedRunningTime="2026-07-20 22:49:45.468216883 +0000 UTC m=+1606.859472079"
Jul 20 22:49:46.455804 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:46.455770    2572 generic.go:356] "Generic (PLEG): container finished" podID="7328ba40-c6ad-44f0-a110-efdfac50b7d9" containerID="5a658b30183d4dca94299e43cf5d147e89c6ebf47d12e2cc66030bdf5e3ec361" exitCode=0
Jul 20 22:49:46.456228 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:46.455842    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd" event={"ID":"7328ba40-c6ad-44f0-a110-efdfac50b7d9","Type":"ContainerDied","Data":"5a658b30183d4dca94299e43cf5d147e89c6ebf47d12e2cc66030bdf5e3ec361"}
Jul 20 22:49:47.584499 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:47.584472    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"
Jul 20 22:49:47.758527 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:47.758433    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7328ba40-c6ad-44f0-a110-efdfac50b7d9-maas-api-service-ca\") pod \"7328ba40-c6ad-44f0-a110-efdfac50b7d9\" (UID: \"7328ba40-c6ad-44f0-a110-efdfac50b7d9\") "
Jul 20 22:49:47.758811 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:47.758788    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7328ba40-c6ad-44f0-a110-efdfac50b7d9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7328ba40-c6ad-44f0-a110-efdfac50b7d9" (UID: "7328ba40-c6ad-44f0-a110-efdfac50b7d9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:49:47.859942 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:47.859906    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7328ba40-c6ad-44f0-a110-efdfac50b7d9-maas-api-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:49:48.465126 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:48.465076    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd" event={"ID":"7328ba40-c6ad-44f0-a110-efdfac50b7d9","Type":"ContainerDied","Data":"ef92d01ae2c2cda3c734c1b670d67da51399192051bf84020daadf1d555a80b6"}
Jul 20 22:49:48.465296 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:48.465145    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef92d01ae2c2cda3c734c1b670d67da51399192051bf84020daadf1d555a80b6"
Jul 20 22:49:48.465296 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:48.465097    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"
Jul 20 22:49:54.724498 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:54.724421    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"]
Jul 20 22:49:54.724998 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:54.724651    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn" podUID="5f96c569-5726-45ff-91b5-40fdcc045844" containerName="maas-api" containerID="cri-o://b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf" gracePeriod=30
Jul 20 22:49:54.748275 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:54.748250    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:54.960539 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:54.960518    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:55.018302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.018221    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls\") pod \"5f96c569-5726-45ff-91b5-40fdcc045844\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") "
Jul 20 22:49:55.018302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.018269    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f96c569-5726-45ff-91b5-40fdcc045844-openshift-service-ca\") pod \"5f96c569-5726-45ff-91b5-40fdcc045844\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") "
Jul 20 22:49:55.018302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.018294    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p62h\" (UniqueName: \"kubernetes.io/projected/5f96c569-5726-45ff-91b5-40fdcc045844-kube-api-access-7p62h\") pod \"5f96c569-5726-45ff-91b5-40fdcc045844\" (UID: \"5f96c569-5726-45ff-91b5-40fdcc045844\") "
Jul 20 22:49:55.018710 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.018661    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f96c569-5726-45ff-91b5-40fdcc045844-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f96c569-5726-45ff-91b5-40fdcc045844" (UID: "5f96c569-5726-45ff-91b5-40fdcc045844"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:49:55.020410 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.020387    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f96c569-5726-45ff-91b5-40fdcc045844" (UID: "5f96c569-5726-45ff-91b5-40fdcc045844"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:49:55.020501 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.020445    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f96c569-5726-45ff-91b5-40fdcc045844-kube-api-access-7p62h" (OuterVolumeSpecName: "kube-api-access-7p62h") pod "5f96c569-5726-45ff-91b5-40fdcc045844" (UID: "5f96c569-5726-45ff-91b5-40fdcc045844"). InnerVolumeSpecName "kube-api-access-7p62h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:49:55.119058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.119025    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f96c569-5726-45ff-91b5-40fdcc045844-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:49:55.119058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.119053    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p62h\" (UniqueName: \"kubernetes.io/projected/5f96c569-5726-45ff-91b5-40fdcc045844-kube-api-access-7p62h\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:49:55.119058 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.119063    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f96c569-5726-45ff-91b5-40fdcc045844-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:49:55.496507 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.496474    2572 generic.go:356] "Generic (PLEG): container finished" podID="5f96c569-5726-45ff-91b5-40fdcc045844" containerID="b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf" exitCode=0
Jul 20 22:49:55.496721 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.496520    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"
Jul 20 22:49:55.496721 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.496544    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn" event={"ID":"5f96c569-5726-45ff-91b5-40fdcc045844","Type":"ContainerDied","Data":"b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf"}
Jul 20 22:49:55.496721 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.496594    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn" event={"ID":"5f96c569-5726-45ff-91b5-40fdcc045844","Type":"ContainerDied","Data":"ea893b8616ce9e5be7906c860fd91101deed9f97a76a2fcdc781c9cfb2f70426"}
Jul 20 22:49:55.496721 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.496625    2572 scope.go:117] "RemoveContainer" containerID="b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf"
Jul 20 22:49:55.504736 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.504710    2572 scope.go:117] "RemoveContainer" containerID="b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf"
Jul 20 22:49:55.504990 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:49:55.504974    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf\": container with ID starting with b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf not found: ID does not exist" containerID="b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf"
Jul 20 22:49:55.505045 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.504997    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf"} err="failed to get container status \"b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf\": rpc error: code = NotFound desc = could not find container \"b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf\": container with ID starting with b8e8950758e35ef1067e52261b2bf745604987c3dbfa22a2915013733239afcf not found: ID does not exist"
Jul 20 22:49:55.512158 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.512129    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"]
Jul 20 22:49:55.516056 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:55.516036    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c1ccb75-7cd4bbcd9-btzvn"]
Jul 20 22:49:57.168861 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:57.168822    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f96c569-5726-45ff-91b5-40fdcc045844" path="/var/lib/kubelet/pods/5f96c569-5726-45ff-91b5-40fdcc045844/volumes"
Jul 20 22:49:59.368589 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:59.368550    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"]
Jul 20 22:49:59.371933 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:59.371902    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c1ccb75-w8vrd"]
Jul 20 22:49:59.372496 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:59.372471    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:59.529237 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:59.529158    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:49:59.763193 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:49:59.763153    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:00.018078 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.018045    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:00.114850 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.114820    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:00.215823 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.215710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:00.504481 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.504451    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"]
Jul 20 22:50:00.504935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.504759    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7328ba40-c6ad-44f0-a110-efdfac50b7d9" containerName="revoke-keys"
Jul 20 22:50:00.504935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.504771    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7328ba40-c6ad-44f0-a110-efdfac50b7d9" containerName="revoke-keys"
Jul 20 22:50:00.504935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.504783    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f96c569-5726-45ff-91b5-40fdcc045844" containerName="maas-api"
Jul 20 22:50:00.504935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.504788    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f96c569-5726-45ff-91b5-40fdcc045844" containerName="maas-api"
Jul 20 22:50:00.504935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.504838    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7328ba40-c6ad-44f0-a110-efdfac50b7d9" containerName="revoke-keys"
Jul 20 22:50:00.504935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.504847    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f96c569-5726-45ff-91b5-40fdcc045844" containerName="maas-api"
Jul 20 22:50:00.507615 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.507594    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.510514 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.510494    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-efdde4dc-gw-openshift-default-dockercfg-nk98w\""
Jul 20 22:50:00.510750 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.510735    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 22:50:00.522107 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.522083    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"]
Jul 20 22:50:00.548071 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.548042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:00.569222 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569197    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-credential-socket\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.569336 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569229    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-token\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.569336 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-data\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.569425 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e687f00b-3f08-40ed-ab17-cedeeaec7483-istiod-ca-cert\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.569425 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-certs\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.569499 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569434    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-socket\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.569499 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-envoy\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.569564 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569495    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-podinfo\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.569564 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.569519    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8252s\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-kube-api-access-8252s\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670083 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670052    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-socket\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-envoy\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-podinfo\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8252s\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-kube-api-access-8252s\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-credential-socket\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-token\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670515 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670488    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-data\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670570 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670495    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-socket\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670627 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670552    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-credential-socket\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670679 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670615    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e687f00b-3f08-40ed-ab17-cedeeaec7483-istiod-ca-cert\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670679 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-certs\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670797 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670757    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-data\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.670982 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.670961    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-certs\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.671340 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.671315    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e687f00b-3f08-40ed-ab17-cedeeaec7483-istiod-ca-cert\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.671904 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.671850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:00.672716 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.672676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-envoy\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.672827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.672812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-podinfo\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.678416 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.678398    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-token\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.679787 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.679764    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8252s\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-kube-api-access-8252s\") pod \"e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") " pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.818576 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.818544    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:00.966405 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.966381    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"]
Jul 20 22:50:00.968796 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:50:00.968764    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode687f00b_3f08_40ed_ab17_cedeeaec7483.slice/crio-cf5e8df1fb265c983eeeb7e312f01501211a2962a00de9e12304ad1ab18b9808 WatchSource:0}: Error finding container cf5e8df1fb265c983eeeb7e312f01501211a2962a00de9e12304ad1ab18b9808: Status 404 returned error can't find the container with id cf5e8df1fb265c983eeeb7e312f01501211a2962a00de9e12304ad1ab18b9808
Jul 20 22:50:00.970908 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:00.970892    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:50:01.169513 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:01.169433    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7328ba40-c6ad-44f0-a110-efdfac50b7d9" path="/var/lib/kubelet/pods/7328ba40-c6ad-44f0-a110-efdfac50b7d9/volumes"
Jul 20 22:50:01.523034 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:01.522951    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" event={"ID":"e687f00b-3f08-40ed-ab17-cedeeaec7483","Type":"ContainerStarted","Data":"cf5e8df1fb265c983eeeb7e312f01501211a2962a00de9e12304ad1ab18b9808"}
Jul 20 22:50:04.097869 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:04.097828    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:50:04.098131 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:04.097903    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:50:04.098131 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:04.097932    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:50:04.541220 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:04.541131    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" event={"ID":"e687f00b-3f08-40ed-ab17-cedeeaec7483","Type":"ContainerStarted","Data":"ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847"}
Jul 20 22:50:04.565937 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:04.565872    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" podStartSLOduration=1.4393579380000001 podStartE2EDuration="4.565851399s" totalImagesPullingTime="3.126493461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:50:04.562771863 +0000 UTC m=+1625.954027072" watchObservedRunningTime="2026-07-20 22:50:04.565851399 +0000 UTC m=+1625.957106595"
Jul 20 22:50:04.819495 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:04.819454    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:05.823713 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:05.823666    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:06.021649 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.021608    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:06.122444 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.122366    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"]
Jul 20 22:50:06.125446 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.125431    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.128089 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.128068    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 22:50:06.128217 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.128111    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-efdde4dc-serving-cert\""
Jul 20 22:50:06.128286 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.128240    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:50:06.128384 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.128356    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 22:50:06.135018 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.134993    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"]
Jul 20 22:50:06.222064 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.222026    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-openshift-service-ca\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.222234 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.222094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7zlx\" (UniqueName: \"kubernetes.io/projected/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-kube-api-access-b7zlx\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.222234 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.222176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.323467 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.323431    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7zlx\" (UniqueName: \"kubernetes.io/projected/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-kube-api-access-b7zlx\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.323642 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.323507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.323642 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.323551    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-openshift-service-ca\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.323752 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:50:06.323666    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-serving-cert: secret "maas-api-e2e-migrate-efdde4dc-serving-cert" not found
Jul 20 22:50:06.323789 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:50:06.323760    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls podName:e0c997c1-0f1a-4f65-bda3-9952cb87fb96 nodeName:}" failed. No retries permitted until 2026-07-20 22:50:06.82374052 +0000 UTC m=+1628.214995694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls") pod "maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8" (UID: "e0c997c1-0f1a-4f65-bda3-9952cb87fb96") : secret "maas-api-e2e-migrate-efdde4dc-serving-cert" not found
Jul 20 22:50:06.324277 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.324259    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-openshift-service-ca\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.332645 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.332616    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7zlx\" (UniqueName: \"kubernetes.io/projected/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-kube-api-access-b7zlx\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.550244 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.550162    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:06.551315 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.551293    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:06.828313 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.828280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:06.830663 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:06.830637    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls\") pod \"maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:07.035639 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:07.035605    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:07.170380 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:50:07.170352    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c997c1_0f1a_4f65_bda3_9952cb87fb96.slice/crio-26425f73a211795db49d971d0900cd2ec4e5277b087c4dddfa9e5efd90ae7fed WatchSource:0}: Error finding container 26425f73a211795db49d971d0900cd2ec4e5277b087c4dddfa9e5efd90ae7fed: Status 404 returned error can't find the container with id 26425f73a211795db49d971d0900cd2ec4e5277b087c4dddfa9e5efd90ae7fed
Jul 20 22:50:07.171130 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:07.171110    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"]
Jul 20 22:50:07.411573 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:07.411497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:07.555248 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:07.555215    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8" event={"ID":"e0c997c1-0f1a-4f65-bda3-9952cb87fb96","Type":"ContainerStarted","Data":"d76cf35eb9f8d771316587078c59ce091b49ed150598956a6e3b7a503dadaafd"}
Jul 20 22:50:07.555382 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:07.555268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8" event={"ID":"e0c997c1-0f1a-4f65-bda3-9952cb87fb96","Type":"ContainerStarted","Data":"26425f73a211795db49d971d0900cd2ec4e5277b087c4dddfa9e5efd90ae7fed"}
Jul 20 22:50:07.555443 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:07.555382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:07.573265 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:07.573219    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8" podStartSLOduration=1.260494595 podStartE2EDuration="1.573200753s" totalImagesPullingTime="312.706158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:50:07.571402797 +0000 UTC m=+1628.962657994" watchObservedRunningTime="2026-07-20 22:50:07.573200753 +0000 UTC m=+1628.964455948"
Jul 20 22:50:13.574003 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:13.573968    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:18.612323 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:18.612286    2572 generic.go:356] "Generic (PLEG): container finished" podID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerID="ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847" exitCode=0
Jul 20 22:50:18.612752 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:18.612358    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" event={"ID":"e687f00b-3f08-40ed-ab17-cedeeaec7483","Type":"ContainerDied","Data":"ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847"}
Jul 20 22:50:18.612752 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:18.612745    2572 scope.go:117] "RemoveContainer" containerID="ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847"
Jul 20 22:50:18.614653 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:18.614624    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:50:18.614728 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:18.614712    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:50:18.614765 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:18.614745    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:50:19.618219 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:19.618188    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" event={"ID":"e687f00b-3f08-40ed-ab17-cedeeaec7483","Type":"ContainerStarted","Data":"19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71"}
Jul 20 22:50:19.819717 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:19.819656    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:19.820904 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:19.820880    2572 patch_prober.go:28] interesting pod/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 20 22:50:19.820967 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:19.820932    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 20 22:50:20.819344 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:20.819305    2572 patch_prober.go:28] interesting pod/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 20 22:50:20.819740 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:20.819370    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 20 22:50:21.550808 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:21.550764    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:21.819975 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:21.819944    2572 patch_prober.go:28] interesting pod/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 20 22:50:21.820362 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:21.820004    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 20 22:50:22.819639 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:22.819596    2572 patch_prober.go:28] interesting pod/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Jul 20 22:50:22.819851 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:22.819669    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Jul 20 22:50:23.823545 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:23.823517    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:23.824488 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:23.824462    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:41.471340 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.471305    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"]
Jul 20 22:50:41.471964 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.471545    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8" podUID="e0c997c1-0f1a-4f65-bda3-9952cb87fb96" containerName="maas-api" containerID="cri-o://d76cf35eb9f8d771316587078c59ce091b49ed150598956a6e3b7a503dadaafd" gracePeriod=30
Jul 20 22:50:41.508428 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.508396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:41.710077 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.710052    2572 generic.go:356] "Generic (PLEG): container finished" podID="e0c997c1-0f1a-4f65-bda3-9952cb87fb96" containerID="d76cf35eb9f8d771316587078c59ce091b49ed150598956a6e3b7a503dadaafd" exitCode=0
Jul 20 22:50:41.710195 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.710124    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8" event={"ID":"e0c997c1-0f1a-4f65-bda3-9952cb87fb96","Type":"ContainerDied","Data":"d76cf35eb9f8d771316587078c59ce091b49ed150598956a6e3b7a503dadaafd"}
Jul 20 22:50:41.710195 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.710175    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8" event={"ID":"e0c997c1-0f1a-4f65-bda3-9952cb87fb96","Type":"ContainerDied","Data":"26425f73a211795db49d971d0900cd2ec4e5277b087c4dddfa9e5efd90ae7fed"}
Jul 20 22:50:41.710195 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.710191    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26425f73a211795db49d971d0900cd2ec4e5277b087c4dddfa9e5efd90ae7fed"
Jul 20 22:50:41.712223 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.712206    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:41.833034 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.832998    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls\") pod \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") "
Jul 20 22:50:41.833192 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.833146    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-openshift-service-ca\") pod \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") "
Jul 20 22:50:41.833192 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.833167    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7zlx\" (UniqueName: \"kubernetes.io/projected/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-kube-api-access-b7zlx\") pod \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\" (UID: \"e0c997c1-0f1a-4f65-bda3-9952cb87fb96\") "
Jul 20 22:50:41.833526 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.833495    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0c997c1-0f1a-4f65-bda3-9952cb87fb96" (UID: "e0c997c1-0f1a-4f65-bda3-9952cb87fb96"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:50:41.835248 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.835226    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0c997c1-0f1a-4f65-bda3-9952cb87fb96" (UID: "e0c997c1-0f1a-4f65-bda3-9952cb87fb96"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:50:41.835345 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.835275    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-kube-api-access-b7zlx" (OuterVolumeSpecName: "kube-api-access-b7zlx") pod "e0c997c1-0f1a-4f65-bda3-9952cb87fb96" (UID: "e0c997c1-0f1a-4f65-bda3-9952cb87fb96"). InnerVolumeSpecName "kube-api-access-b7zlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:50:41.934351 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.934318    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:41.934351 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.934346    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7zlx\" (UniqueName: \"kubernetes.io/projected/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-kube-api-access-b7zlx\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:41.934351 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:41.934355    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0c997c1-0f1a-4f65-bda3-9952cb87fb96-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:42.713935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:42.713898    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"
Jul 20 22:50:42.735924 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:42.735871    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"]
Jul 20 22:50:42.739748 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:42.739719    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-efdde4dc-5777db868c-9pxn8"]
Jul 20 22:50:43.168665 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:43.168629    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0c997c1-0f1a-4f65-bda3-9952cb87fb96" path="/var/lib/kubelet/pods/e0c997c1-0f1a-4f65-bda3-9952cb87fb96/volumes"
Jul 20 22:50:46.143218 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:46.143179    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:46.296855 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:46.296824    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"]
Jul 20 22:50:46.297060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:46.297036    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy" containerID="cri-o://19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71" gracePeriod=30
Jul 20 22:50:46.323597 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:46.323552    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:46.555517 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:46.555474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:46.773850 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:46.773815    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:47.131681 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:47.131646    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:47.292800 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:47.292759    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:49.226020 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.225975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:49.325968 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.325938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:49.382767 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.382731    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"]
Jul 20 22:50:49.383032 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.383020    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0c997c1-0f1a-4f65-bda3-9952cb87fb96" containerName="maas-api"
Jul 20 22:50:49.383077 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.383034    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c997c1-0f1a-4f65-bda3-9952cb87fb96" containerName="maas-api"
Jul 20 22:50:49.383111 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.383088    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0c997c1-0f1a-4f65-bda3-9952cb87fb96" containerName="maas-api"
Jul 20 22:50:49.386252 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.386229    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.388919 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.388890    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 22:50:49.389056 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.388968    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0958ca08-serving-cert\""
Jul 20 22:50:49.389056 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.389045    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:50:49.389755 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.389734    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 22:50:49.398394 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.398345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe221570-ae89-4b37-9ee0-25fa02f871b6-openshift-service-ca\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.398594 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.398464    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl7dp\" (UniqueName: \"kubernetes.io/projected/fe221570-ae89-4b37-9ee0-25fa02f871b6-kube-api-access-zl7dp\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.398594 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.398549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.400676 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.400657    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"]
Jul 20 22:50:49.423722 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.423672    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:49.499047 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.498961    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.499047 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.499017    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe221570-ae89-4b37-9ee0-25fa02f871b6-openshift-service-ca\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.499270 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.499070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl7dp\" (UniqueName: \"kubernetes.io/projected/fe221570-ae89-4b37-9ee0-25fa02f871b6-kube-api-access-zl7dp\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.499270 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:50:49.499182    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-serving-cert: secret "maas-api-e2e-ait-0958ca08-serving-cert" not found
Jul 20 22:50:49.499270 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:50:49.499250    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls podName:fe221570-ae89-4b37-9ee0-25fa02f871b6 nodeName:}" failed. No retries permitted until 2026-07-20 22:50:49.999229332 +0000 UTC m=+1671.390484522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls") pod "maas-api-e2e-ait-0958ca08-676799c64c-g2mqq" (UID: "fe221570-ae89-4b37-9ee0-25fa02f871b6") : secret "maas-api-e2e-ait-0958ca08-serving-cert" not found
Jul 20 22:50:49.499633 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.499614    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe221570-ae89-4b37-9ee0-25fa02f871b6-openshift-service-ca\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.511560 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.511530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl7dp\" (UniqueName: \"kubernetes.io/projected/fe221570-ae89-4b37-9ee0-25fa02f871b6-kube-api-access-zl7dp\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:49.993871 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:49.993830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:50.002351 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:50.002316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:50.002508 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:50:50.002479    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-serving-cert: secret "maas-api-e2e-ait-0958ca08-serving-cert" not found
Jul 20 22:50:50.002579 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:50:50.002569    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls podName:fe221570-ae89-4b37-9ee0-25fa02f871b6 nodeName:}" failed. No retries permitted until 2026-07-20 22:50:51.002545898 +0000 UTC m=+1672.393801078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls") pod "maas-api-e2e-ait-0958ca08-676799c64c-g2mqq" (UID: "fe221570-ae89-4b37-9ee0-25fa02f871b6") : secret "maas-api-e2e-ait-0958ca08-serving-cert" not found
Jul 20 22:50:50.094748 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:50.094716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:50.194639 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:50.194601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:50:51.013349 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.013311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:51.015677 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.015654    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls\") pod \"maas-api-e2e-ait-0958ca08-676799c64c-g2mqq\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:51.196784 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.196748    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:51.325753 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.325713    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"]
Jul 20 22:50:51.384712 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:50:51.384659    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe221570_ae89_4b37_9ee0_25fa02f871b6.slice/crio-fcfc73ba46db7ce9a866f4ef348d79ba33cf09d0c073bc06ab299055c970dee2 WatchSource:0}: Error finding container fcfc73ba46db7ce9a866f4ef348d79ba33cf09d0c073bc06ab299055c970dee2: Status 404 returned error can't find the container with id fcfc73ba46db7ce9a866f4ef348d79ba33cf09d0c073bc06ab299055c970dee2
Jul 20 22:50:51.529374 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.529317    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:51.620472 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620439    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-data\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620472 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620480    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-envoy\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620667 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620513    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-credential-socket\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620667 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620543    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-socket\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620667 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620606    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-token\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620667 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620629    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-certs\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620681    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e687f00b-3f08-40ed-ab17-cedeeaec7483-istiod-ca-cert\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620731    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8252s\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-kube-api-access-8252s\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620762    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-podinfo\") pod \"e687f00b-3f08-40ed-ab17-cedeeaec7483\" (UID: \"e687f00b-3f08-40ed-ab17-cedeeaec7483\") "
Jul 20 22:50:51.620931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620887    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:50:51.620931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.620905    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:50:51.621194 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.621046    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-credential-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.621194 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.621064    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.621298 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.621221    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e687f00b-3f08-40ed-ab17-cedeeaec7483-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:50:51.621298 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.621231    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:50:51.621439 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.621415    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-data" (OuterVolumeSpecName: "istio-data") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:50:51.623012 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.622987    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 22:50:51.623113 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.623029    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-token" (OuterVolumeSpecName: "istio-token") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:50:51.623113 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.623072    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:50:51.623113 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.623103    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-kube-api-access-8252s" (OuterVolumeSpecName: "kube-api-access-8252s") pod "e687f00b-3f08-40ed-ab17-cedeeaec7483" (UID: "e687f00b-3f08-40ed-ab17-cedeeaec7483"). InnerVolumeSpecName "kube-api-access-8252s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:50:51.721764 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.721726    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e687f00b-3f08-40ed-ab17-cedeeaec7483-istiod-ca-cert\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.721764 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.721756    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8252s\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-kube-api-access-8252s\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.721764 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.721766    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-podinfo\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.721764 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.721776    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-data\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.722017 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.721784    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-envoy\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.722017 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.721791    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e687f00b-3f08-40ed-ab17-cedeeaec7483-istio-token\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.722017 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.721798    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e687f00b-3f08-40ed-ab17-cedeeaec7483-workload-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:50:51.755854 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.755811    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq" event={"ID":"fe221570-ae89-4b37-9ee0-25fa02f871b6","Type":"ContainerStarted","Data":"fcfc73ba46db7ce9a866f4ef348d79ba33cf09d0c073bc06ab299055c970dee2"}
Jul 20 22:50:51.757329 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.757302    2572 generic.go:356] "Generic (PLEG): container finished" podID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerID="19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71" exitCode=0
Jul 20 22:50:51.757440 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.757353    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" event={"ID":"e687f00b-3f08-40ed-ab17-cedeeaec7483","Type":"ContainerDied","Data":"19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71"}
Jul 20 22:50:51.757440 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.757356    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"
Jul 20 22:50:51.757440 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.757389    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r" event={"ID":"e687f00b-3f08-40ed-ab17-cedeeaec7483","Type":"ContainerDied","Data":"cf5e8df1fb265c983eeeb7e312f01501211a2962a00de9e12304ad1ab18b9808"}
Jul 20 22:50:51.757440 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.757411    2572 scope.go:117] "RemoveContainer" containerID="19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71"
Jul 20 22:50:51.766263 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.766247    2572 scope.go:117] "RemoveContainer" containerID="ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847"
Jul 20 22:50:51.773992 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.773976    2572 scope.go:117] "RemoveContainer" containerID="19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71"
Jul 20 22:50:51.774236 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:50:51.774219    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71\": container with ID starting with 19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71 not found: ID does not exist" containerID="19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71"
Jul 20 22:50:51.774282 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.774244    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71"} err="failed to get container status \"19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71\": rpc error: code = NotFound desc = could not find container \"19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71\": container with ID starting with 19f3d207d0d2bdf637bd795d6d687c2c47d2398397b6a04a94f4153701aa2a71 not found: ID does not exist"
Jul 20 22:50:51.774282 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.774260    2572 scope.go:117] "RemoveContainer" containerID="ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847"
Jul 20 22:50:51.774495 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:50:51.774476    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847\": container with ID starting with ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847 not found: ID does not exist" containerID="ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847"
Jul 20 22:50:51.774551 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.774505    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847"} err="failed to get container status \"ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847\": rpc error: code = NotFound desc = could not find container \"ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847\": container with ID starting with ebd9e66178b3d7a983c4db053628211d85814594adf6a9477acc4b09a3bee847 not found: ID does not exist"
Jul 20 22:50:51.779467 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.779410    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"]
Jul 20 22:50:51.785156 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:51.785135    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-efdde4dc-gw-openshift-default-755cc75459-wrh4r"]
Jul 20 22:50:52.763367 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:52.763329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq" event={"ID":"fe221570-ae89-4b37-9ee0-25fa02f871b6","Type":"ContainerStarted","Data":"5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1"}
Jul 20 22:50:52.763894 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:52.763396    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:50:52.780527 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:52.780469    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq" podStartSLOduration=3.205741773 podStartE2EDuration="3.780448548s" totalImagesPullingTime="574.706775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:50:52.780200382 +0000 UTC m=+1674.171455571" watchObservedRunningTime="2026-07-20 22:50:52.780448548 +0000 UTC m=+1674.171703745"
Jul 20 22:50:53.170020 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:53.169980    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" path="/var/lib/kubelet/pods/e687f00b-3f08-40ed-ab17-cedeeaec7483/volumes"
Jul 20 22:50:58.774952 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:50:58.774918    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:51:15.018425 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.018390    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"]
Jul 20 22:51:15.018877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.018666    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy"
Jul 20 22:51:15.018877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.018677    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy"
Jul 20 22:51:15.018877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.018709    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy"
Jul 20 22:51:15.018877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.018714    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy"
Jul 20 22:51:15.018877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.018763    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy"
Jul 20 22:51:15.018877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.018770    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e687f00b-3f08-40ed-ab17-cedeeaec7483" containerName="istio-proxy"
Jul 20 22:51:15.021604 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.021587    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"
Jul 20 22:51:15.023991 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.023971    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 22:51:15.029570 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.029537    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"]
Jul 20 22:51:15.117420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.117386    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c92fd4-f106-4116-af87-bf6042a0ab62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn\" (UID: \"65c92fd4-f106-4116-af87-bf6042a0ab62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"
Jul 20 22:51:15.218547 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.218507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c92fd4-f106-4116-af87-bf6042a0ab62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn\" (UID: \"65c92fd4-f106-4116-af87-bf6042a0ab62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"
Jul 20 22:51:15.219182 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.219155    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c92fd4-f106-4116-af87-bf6042a0ab62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn\" (UID: \"65c92fd4-f106-4116-af87-bf6042a0ab62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"
Jul 20 22:51:15.332319 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.332286    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"
Jul 20 22:51:15.481166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.481139    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"]
Jul 20 22:51:15.482826 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:51:15.482800    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c92fd4_f106_4116_af87_bf6042a0ab62.slice/crio-eabf66fed5e2d79291ce8ee888d77555fd1fd11011e5d5d744ddc541b7e5bcfd WatchSource:0}: Error finding container eabf66fed5e2d79291ce8ee888d77555fd1fd11011e5d5d744ddc541b7e5bcfd: Status 404 returned error can't find the container with id eabf66fed5e2d79291ce8ee888d77555fd1fd11011e5d5d744ddc541b7e5bcfd
Jul 20 22:51:15.862878 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.862844    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn" event={"ID":"65c92fd4-f106-4116-af87-bf6042a0ab62","Type":"ContainerStarted","Data":"dd3233e7b59e9b901126643ad817ead2adf3cc202b2839978f57e23159be0cc3"}
Jul 20 22:51:15.863050 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.862895    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn" event={"ID":"65c92fd4-f106-4116-af87-bf6042a0ab62","Type":"ContainerStarted","Data":"eabf66fed5e2d79291ce8ee888d77555fd1fd11011e5d5d744ddc541b7e5bcfd"}
Jul 20 22:51:15.880824 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:15.880768    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn" podStartSLOduration=0.880753334 podStartE2EDuration="880.753334ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:51:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:51:15.879662971 +0000 UTC m=+1697.270918169" watchObservedRunningTime="2026-07-20 22:51:15.880753334 +0000 UTC m=+1697.272008529"
Jul 20 22:51:16.868004 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:16.867966    2572 generic.go:356] "Generic (PLEG): container finished" podID="65c92fd4-f106-4116-af87-bf6042a0ab62" containerID="dd3233e7b59e9b901126643ad817ead2adf3cc202b2839978f57e23159be0cc3" exitCode=0
Jul 20 22:51:16.868446 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:16.868023    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn" event={"ID":"65c92fd4-f106-4116-af87-bf6042a0ab62","Type":"ContainerDied","Data":"dd3233e7b59e9b901126643ad817ead2adf3cc202b2839978f57e23159be0cc3"}
Jul 20 22:51:17.996196 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:17.996173    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"
Jul 20 22:51:18.144325 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:18.144233    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c92fd4-f106-4116-af87-bf6042a0ab62-maas-api-service-ca\") pod \"65c92fd4-f106-4116-af87-bf6042a0ab62\" (UID: \"65c92fd4-f106-4116-af87-bf6042a0ab62\") "
Jul 20 22:51:18.144602 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:18.144571    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65c92fd4-f106-4116-af87-bf6042a0ab62-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "65c92fd4-f106-4116-af87-bf6042a0ab62" (UID: "65c92fd4-f106-4116-af87-bf6042a0ab62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:51:18.244822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:18.244789    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c92fd4-f106-4116-af87-bf6042a0ab62-maas-api-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:51:18.876950 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:18.876909    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn" event={"ID":"65c92fd4-f106-4116-af87-bf6042a0ab62","Type":"ContainerDied","Data":"eabf66fed5e2d79291ce8ee888d77555fd1fd11011e5d5d744ddc541b7e5bcfd"}
Jul 20 22:51:18.877131 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:18.876959    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eabf66fed5e2d79291ce8ee888d77555fd1fd11011e5d5d744ddc541b7e5bcfd"
Jul 20 22:51:18.877131 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:18.876918    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"
Jul 20 22:51:25.579708 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.579610    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"]
Jul 20 22:51:25.580247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.579822    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq" podUID="fe221570-ae89-4b37-9ee0-25fa02f871b6" containerName="maas-api" containerID="cri-o://5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1" gracePeriod=30
Jul 20 22:51:25.606415 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.606386    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:25.816907 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.816877    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:51:25.908050 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.907953    2572 generic.go:356] "Generic (PLEG): container finished" podID="fe221570-ae89-4b37-9ee0-25fa02f871b6" containerID="5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1" exitCode=0
Jul 20 22:51:25.908050 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.908011    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"
Jul 20 22:51:25.908050 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.908026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq" event={"ID":"fe221570-ae89-4b37-9ee0-25fa02f871b6","Type":"ContainerDied","Data":"5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1"}
Jul 20 22:51:25.908330 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.908082    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq" event={"ID":"fe221570-ae89-4b37-9ee0-25fa02f871b6","Type":"ContainerDied","Data":"fcfc73ba46db7ce9a866f4ef348d79ba33cf09d0c073bc06ab299055c970dee2"}
Jul 20 22:51:25.908330 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.908109    2572 scope.go:117] "RemoveContainer" containerID="5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1"
Jul 20 22:51:25.910312 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.910296    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls\") pod \"fe221570-ae89-4b37-9ee0-25fa02f871b6\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") "
Jul 20 22:51:25.910378 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.910344    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe221570-ae89-4b37-9ee0-25fa02f871b6-openshift-service-ca\") pod \"fe221570-ae89-4b37-9ee0-25fa02f871b6\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") "
Jul 20 22:51:25.910420 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.910396    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl7dp\" (UniqueName: \"kubernetes.io/projected/fe221570-ae89-4b37-9ee0-25fa02f871b6-kube-api-access-zl7dp\") pod \"fe221570-ae89-4b37-9ee0-25fa02f871b6\" (UID: \"fe221570-ae89-4b37-9ee0-25fa02f871b6\") "
Jul 20 22:51:25.910809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.910785    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe221570-ae89-4b37-9ee0-25fa02f871b6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe221570-ae89-4b37-9ee0-25fa02f871b6" (UID: "fe221570-ae89-4b37-9ee0-25fa02f871b6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:51:25.912369 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.912340    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe221570-ae89-4b37-9ee0-25fa02f871b6" (UID: "fe221570-ae89-4b37-9ee0-25fa02f871b6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:51:25.912507 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.912488    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe221570-ae89-4b37-9ee0-25fa02f871b6-kube-api-access-zl7dp" (OuterVolumeSpecName: "kube-api-access-zl7dp") pod "fe221570-ae89-4b37-9ee0-25fa02f871b6" (UID: "fe221570-ae89-4b37-9ee0-25fa02f871b6"). InnerVolumeSpecName "kube-api-access-zl7dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:51:25.926105 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.926085    2572 scope.go:117] "RemoveContainer" containerID="5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1"
Jul 20 22:51:25.926370 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:51:25.926350    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1\": container with ID starting with 5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1 not found: ID does not exist" containerID="5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1"
Jul 20 22:51:25.926417 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:25.926379    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1"} err="failed to get container status \"5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1\": rpc error: code = NotFound desc = could not find container \"5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1\": container with ID starting with 5dc4e84bafb78c170f5a90f63c82143befc191b1ad65f51bad99200926a818f1 not found: ID does not exist"
Jul 20 22:51:26.011328 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:26.011297    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe221570-ae89-4b37-9ee0-25fa02f871b6-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:51:26.011328 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:26.011322    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl7dp\" (UniqueName: \"kubernetes.io/projected/fe221570-ae89-4b37-9ee0-25fa02f871b6-kube-api-access-zl7dp\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:51:26.011328 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:26.011332    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe221570-ae89-4b37-9ee0-25fa02f871b6-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:51:26.232886 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:26.232855    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"]
Jul 20 22:51:26.236976 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:26.236948    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0958ca08-676799c64c-g2mqq"]
Jul 20 22:51:27.168967 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:27.168936    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe221570-ae89-4b37-9ee0-25fa02f871b6" path="/var/lib/kubelet/pods/fe221570-ae89-4b37-9ee0-25fa02f871b6/volumes"
Jul 20 22:51:30.096539 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:30.096496    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"]
Jul 20 22:51:30.099134 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:30.099105    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0958ca08-2tkjn"]
Jul 20 22:51:30.099654 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:30.099629    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:31.168822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:31.168787    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c92fd4-f106-4116-af87-bf6042a0ab62" path="/var/lib/kubelet/pods/65c92fd4-f106-4116-af87-bf6042a0ab62/volumes"
Jul 20 22:51:31.304330 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:31.304289    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:31.527654 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:31.527571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:31.760045 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:31.760007    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:32.093252 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.093224    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"]
Jul 20 22:51:32.093534 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.093521    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe221570-ae89-4b37-9ee0-25fa02f871b6" containerName="maas-api"
Jul 20 22:51:32.093534 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.093535    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe221570-ae89-4b37-9ee0-25fa02f871b6" containerName="maas-api"
Jul 20 22:51:32.093625 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.093553    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c92fd4-f106-4116-af87-bf6042a0ab62" containerName="revoke-keys"
Jul 20 22:51:32.093625 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.093558    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c92fd4-f106-4116-af87-bf6042a0ab62" containerName="revoke-keys"
Jul 20 22:51:32.093625 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.093602    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c92fd4-f106-4116-af87-bf6042a0ab62" containerName="revoke-keys"
Jul 20 22:51:32.093625 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.093610    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe221570-ae89-4b37-9ee0-25fa02f871b6" containerName="maas-api"
Jul 20 22:51:32.096643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.096624    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.099191 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.099172    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-258bd95d-openshift-default-dockercfg-j8gl7\""
Jul 20 22:51:32.099392 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.099380    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 22:51:32.114007 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.113983    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"]
Jul 20 22:51:32.125042 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.125016    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:32.262502 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-credential-socket\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.262502 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262509    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-envoy\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.263049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262544    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52ca4d-c5fe-49e6-aac5-62b106895664-istiod-ca-cert\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.263049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262568    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-socket\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.263049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262582    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-data\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.263049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262603    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57d48\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-kube-api-access-57d48\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.263049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262644    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-certs\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.263049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-podinfo\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.263049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.262726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-token\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.311623 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.311585    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:32.363917 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.363798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-credential-socket\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.363917 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.363861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-envoy\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.363917 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.363906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52ca4d-c5fe-49e6-aac5-62b106895664-istiod-ca-cert\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364181 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.363936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-socket\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364181 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.363960    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-data\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364181 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.364094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57d48\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-kube-api-access-57d48\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364181 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.364158    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-certs\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364401 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.364260    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-credential-socket\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364401 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.364315    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-socket\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364401 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.364324    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-podinfo\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364401 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.364383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-token\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364623 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.364458    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-certs\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.364797 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.364775    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-data\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.365057 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.365028    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52ca4d-c5fe-49e6-aac5-62b106895664-istiod-ca-cert\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.366726 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.366679    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-envoy\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.366983 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.366957    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-podinfo\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.373243 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.373220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-token\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.374447 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.374424    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57d48\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-kube-api-access-57d48\") pod \"e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") " pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.407009 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.406974    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:32.547350 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.547320    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"]
Jul 20 22:51:32.549873 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:51:32.549844    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d52ca4d_c5fe_49e6_aac5_62b106895664.slice/crio-a737b2bf54f25d0a29ee0ed44212be4a4de1794346433ea4d4103341c0e788e7 WatchSource:0}: Error finding container a737b2bf54f25d0a29ee0ed44212be4a4de1794346433ea4d4103341c0e788e7: Status 404 returned error can't find the container with id a737b2bf54f25d0a29ee0ed44212be4a4de1794346433ea4d4103341c0e788e7
Jul 20 22:51:32.551913 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.551861    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:51:32.552007 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.551949    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:51:32.552007 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.551983    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:51:32.938303 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.938270    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" event={"ID":"6d52ca4d-c5fe-49e6-aac5-62b106895664","Type":"ContainerStarted","Data":"8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb"}
Jul 20 22:51:32.938474 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.938320    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" event={"ID":"6d52ca4d-c5fe-49e6-aac5-62b106895664","Type":"ContainerStarted","Data":"a737b2bf54f25d0a29ee0ed44212be4a4de1794346433ea4d4103341c0e788e7"}
Jul 20 22:51:32.959757 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:32.959687    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" podStartSLOduration=0.959671707 podStartE2EDuration="959.671707ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:51:32.958664524 +0000 UTC m=+1714.349919719" watchObservedRunningTime="2026-07-20 22:51:32.959671707 +0000 UTC m=+1714.350926902"
Jul 20 22:51:33.407975 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:33.407938    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:33.412686 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:33.412656    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:33.942619 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:33.942594    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:33.943671 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:33.943651    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:34.310894 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.310857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:34.423289 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.423258    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:34.445983 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.445955    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"]
Jul 20 22:51:34.449187 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.449171    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.452563 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.452542    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 22:51:34.452563 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.452553    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-258bd95d-serving-cert\""
Jul 20 22:51:34.452774 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.452579    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:51:34.453119 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.453092    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 22:51:34.475566 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.474267    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"]
Jul 20 22:51:34.556499 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.556466    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:34.583108 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.583035    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4163d86e-9229-49f3-b19b-f24107279b92-openshift-service-ca\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.583108 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.583068    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4163d86e-9229-49f3-b19b-f24107279b92-maas-api-tls\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.583269 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.583155    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkb8s\" (UniqueName: \"kubernetes.io/projected/4163d86e-9229-49f3-b19b-f24107279b92-kube-api-access-bkb8s\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.672504 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.672476    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:34.684532 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.684505    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkb8s\" (UniqueName: \"kubernetes.io/projected/4163d86e-9229-49f3-b19b-f24107279b92-kube-api-access-bkb8s\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.684619 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.684563    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4163d86e-9229-49f3-b19b-f24107279b92-openshift-service-ca\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.684619 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.684582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4163d86e-9229-49f3-b19b-f24107279b92-maas-api-tls\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.685285 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.685259    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4163d86e-9229-49f3-b19b-f24107279b92-openshift-service-ca\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.687093 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.687073    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4163d86e-9229-49f3-b19b-f24107279b92-maas-api-tls\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.695536 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.695517    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkb8s\" (UniqueName: \"kubernetes.io/projected/4163d86e-9229-49f3-b19b-f24107279b92-kube-api-access-bkb8s\") pod \"maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.759459 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.759429    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:34.884072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.884042    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"]
Jul 20 22:51:34.886572 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:51:34.886546    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4163d86e_9229_49f3_b19b_f24107279b92.slice/crio-b8f5b5193b902b6ce83c6d8c31c61dd73765264841e17839cab46cdda6d9ec1e WatchSource:0}: Error finding container b8f5b5193b902b6ce83c6d8c31c61dd73765264841e17839cab46cdda6d9ec1e: Status 404 returned error can't find the container with id b8f5b5193b902b6ce83c6d8c31c61dd73765264841e17839cab46cdda6d9ec1e
Jul 20 22:51:34.947494 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:34.947454    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9" event={"ID":"4163d86e-9229-49f3-b19b-f24107279b92","Type":"ContainerStarted","Data":"b8f5b5193b902b6ce83c6d8c31c61dd73765264841e17839cab46cdda6d9ec1e"}
Jul 20 22:51:35.067153 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:35.067111    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:35.167534 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:35.167431    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:35.952496 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:35.952456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9" event={"ID":"4163d86e-9229-49f3-b19b-f24107279b92","Type":"ContainerStarted","Data":"0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b"}
Jul 20 22:51:35.952944 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:35.952595    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:35.970254 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:35.970208    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9" podStartSLOduration=1.616909715 podStartE2EDuration="1.970194372s" totalImagesPullingTime="353.284657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:51:35.969543916 +0000 UTC m=+1717.360799122" watchObservedRunningTime="2026-07-20 22:51:35.970194372 +0000 UTC m=+1717.361449566"
Jul 20 22:51:41.966995 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:41.966960    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:51:45.004225 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:45.004148    2572 generic.go:356] "Generic (PLEG): container finished" podID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerID="8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb" exitCode=0
Jul 20 22:51:45.004225 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:45.004215    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" event={"ID":"6d52ca4d-c5fe-49e6-aac5-62b106895664","Type":"ContainerDied","Data":"8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb"}
Jul 20 22:51:45.004644 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:45.004576    2572 scope.go:117] "RemoveContainer" containerID="8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb"
Jul 20 22:51:45.005546 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:45.005522    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:51:45.005604 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:45.005591    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:51:45.005640 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:45.005626    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:51:46.010264 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:46.010229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" event={"ID":"6d52ca4d-c5fe-49e6-aac5-62b106895664","Type":"ContainerStarted","Data":"a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91"}
Jul 20 22:51:46.407909 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:46.407868    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:46.409105 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:46.409079    2572 patch_prober.go:28] interesting pod/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 20 22:51:46.409239 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:46.409128    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 20 22:51:47.408020 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:47.407981    2572 patch_prober.go:28] interesting pod/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 20 22:51:47.408482 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:47.408040    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 20 22:51:48.407353 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:48.407317    2572 patch_prober.go:28] interesting pod/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 20 22:51:48.407528 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:48.407381    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 20 22:51:48.943130 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:48.943079    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:49.159114 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:49.159079    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:49.258426 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:49.258332    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:49.407765 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:49.407728    2572 patch_prober.go:28] interesting pod/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 20 22:51:49.407971 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:49.407810    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 20 22:51:50.411371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:50.411339    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:50.412274 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:50.412257    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:51:56.080381 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:56.080343    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:51:56.137989 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:51:56.137950    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:09.639054 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.639024    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"]
Jul 20 22:52:09.639810 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.639263    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9" podUID="4163d86e-9229-49f3-b19b-f24107279b92" containerName="maas-api" containerID="cri-o://0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b" gracePeriod=30
Jul 20 22:52:09.670708 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.670663    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:09.878390 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.878367    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:52:09.986260 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.986176    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkb8s\" (UniqueName: \"kubernetes.io/projected/4163d86e-9229-49f3-b19b-f24107279b92-kube-api-access-bkb8s\") pod \"4163d86e-9229-49f3-b19b-f24107279b92\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") "
Jul 20 22:52:09.986260 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.986230    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4163d86e-9229-49f3-b19b-f24107279b92-maas-api-tls\") pod \"4163d86e-9229-49f3-b19b-f24107279b92\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") "
Jul 20 22:52:09.986442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.986315    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4163d86e-9229-49f3-b19b-f24107279b92-openshift-service-ca\") pod \"4163d86e-9229-49f3-b19b-f24107279b92\" (UID: \"4163d86e-9229-49f3-b19b-f24107279b92\") "
Jul 20 22:52:09.986733 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.986683    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4163d86e-9229-49f3-b19b-f24107279b92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4163d86e-9229-49f3-b19b-f24107279b92" (UID: "4163d86e-9229-49f3-b19b-f24107279b92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:52:09.988282 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.988253    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4163d86e-9229-49f3-b19b-f24107279b92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4163d86e-9229-49f3-b19b-f24107279b92" (UID: "4163d86e-9229-49f3-b19b-f24107279b92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:52:09.988431 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:09.988400    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4163d86e-9229-49f3-b19b-f24107279b92-kube-api-access-bkb8s" (OuterVolumeSpecName: "kube-api-access-bkb8s") pod "4163d86e-9229-49f3-b19b-f24107279b92" (UID: "4163d86e-9229-49f3-b19b-f24107279b92"). InnerVolumeSpecName "kube-api-access-bkb8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:52:10.087249 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.087209    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkb8s\" (UniqueName: \"kubernetes.io/projected/4163d86e-9229-49f3-b19b-f24107279b92-kube-api-access-bkb8s\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:10.087249 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.087244    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4163d86e-9229-49f3-b19b-f24107279b92-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:10.087249 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.087253    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4163d86e-9229-49f3-b19b-f24107279b92-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:10.109708 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.109668    2572 generic.go:356] "Generic (PLEG): container finished" podID="4163d86e-9229-49f3-b19b-f24107279b92" containerID="0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b" exitCode=0
Jul 20 22:52:10.109838 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.109737    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"
Jul 20 22:52:10.109838 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.109760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9" event={"ID":"4163d86e-9229-49f3-b19b-f24107279b92","Type":"ContainerDied","Data":"0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b"}
Jul 20 22:52:10.109838 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.109823    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9" event={"ID":"4163d86e-9229-49f3-b19b-f24107279b92","Type":"ContainerDied","Data":"b8f5b5193b902b6ce83c6d8c31c61dd73765264841e17839cab46cdda6d9ec1e"}
Jul 20 22:52:10.109935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.109855    2572 scope.go:117] "RemoveContainer" containerID="0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b"
Jul 20 22:52:10.118496 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.118474    2572 scope.go:117] "RemoveContainer" containerID="0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b"
Jul 20 22:52:10.118742 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:52:10.118719    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b\": container with ID starting with 0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b not found: ID does not exist" containerID="0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b"
Jul 20 22:52:10.118840 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.118747    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b"} err="failed to get container status \"0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b\": rpc error: code = NotFound desc = could not find container \"0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b\": container with ID starting with 0b99a0da1f2fb126f7f3c9f17d6b7aa99e217c6489d451b452b78c00ee47713b not found: ID does not exist"
Jul 20 22:52:10.133650 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.133621    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"]
Jul 20 22:52:10.137077 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:10.137054    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-258bd95d-7894546dc5-gbfs9"]
Jul 20 22:52:11.169296 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:11.169257    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4163d86e-9229-49f3-b19b-f24107279b92" path="/var/lib/kubelet/pods/4163d86e-9229-49f3-b19b-f24107279b92/volumes"
Jul 20 22:52:14.276064 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:14.276022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:14.412027 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:14.411996    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"]
Jul 20 22:52:14.412222 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:14.412201    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy" containerID="cri-o://a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91" gracePeriod=30
Jul 20 22:52:14.448325 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:14.448289    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:14.681224 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:14.681181    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:15.153274 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:15.153242    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:15.254567 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:15.254531    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:15.354216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:15.354181    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:16.772343 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:16.772304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:19.653449 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.653424    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:52:19.778630 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778537    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-socket\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778630 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778579    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57d48\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-kube-api-access-57d48\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778630 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778605    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52ca4d-c5fe-49e6-aac5-62b106895664-istiod-ca-cert\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778630 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778631    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-credential-socket\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778653    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-token\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778750    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-data\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778776    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-podinfo\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778803    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-envoy\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778829    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-certs\") pod \"6d52ca4d-c5fe-49e6-aac5-62b106895664\" (UID: \"6d52ca4d-c5fe-49e6-aac5-62b106895664\") "
Jul 20 22:52:19.778994 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.778906    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:52:19.779316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.779019    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:52:19.779316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.779089    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d52ca4d-c5fe-49e6-aac5-62b106895664-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:52:19.779316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.779109    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:19.779316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.779125    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-credential-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:19.779316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.779225    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:52:19.779877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.779848    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:52:19.781022 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.780999    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:52:19.781128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.781083    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:52:19.781343 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.781320    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 22:52:19.781409 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.781322    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-kube-api-access-57d48" (OuterVolumeSpecName: "kube-api-access-57d48") pod "6d52ca4d-c5fe-49e6-aac5-62b106895664" (UID: "6d52ca4d-c5fe-49e6-aac5-62b106895664"). InnerVolumeSpecName "kube-api-access-57d48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:52:19.879922 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.879882    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-data\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:19.879922 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.879919    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-podinfo\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:19.879922 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.879927    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-envoy\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:19.880161 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.879935    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d52ca4d-c5fe-49e6-aac5-62b106895664-workload-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:19.880161 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.879961    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57d48\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-kube-api-access-57d48\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:19.880161 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.879970    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d52ca4d-c5fe-49e6-aac5-62b106895664-istiod-ca-cert\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:19.880161 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:19.879977    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d52ca4d-c5fe-49e6-aac5-62b106895664-istio-token\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:52:20.155394 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.155355    2572 generic.go:356] "Generic (PLEG): container finished" podID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerID="a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91" exitCode=0
Jul 20 22:52:20.155558 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.155403    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"
Jul 20 22:52:20.155558 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.155439    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" event={"ID":"6d52ca4d-c5fe-49e6-aac5-62b106895664","Type":"ContainerDied","Data":"a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91"}
Jul 20 22:52:20.155558 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.155492    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn" event={"ID":"6d52ca4d-c5fe-49e6-aac5-62b106895664","Type":"ContainerDied","Data":"a737b2bf54f25d0a29ee0ed44212be4a4de1794346433ea4d4103341c0e788e7"}
Jul 20 22:52:20.155558 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.155516    2572 scope.go:117] "RemoveContainer" containerID="a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91"
Jul 20 22:52:20.164340 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.164323    2572 scope.go:117] "RemoveContainer" containerID="8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb"
Jul 20 22:52:20.172444 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.172423    2572 scope.go:117] "RemoveContainer" containerID="a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91"
Jul 20 22:52:20.172749 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:52:20.172731    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91\": container with ID starting with a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91 not found: ID does not exist" containerID="a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91"
Jul 20 22:52:20.172801 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.172759    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91"} err="failed to get container status \"a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91\": rpc error: code = NotFound desc = could not find container \"a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91\": container with ID starting with a6f19ac115b8b3115a8d2e63de5b58f34b37bf9cd7cb5ab24cd0e66f72a34d91 not found: ID does not exist"
Jul 20 22:52:20.172801 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.172777    2572 scope.go:117] "RemoveContainer" containerID="8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb"
Jul 20 22:52:20.173020 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:52:20.173002    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb\": container with ID starting with 8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb not found: ID does not exist" containerID="8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb"
Jul 20 22:52:20.173062 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.173026    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb"} err="failed to get container status \"8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb\": rpc error: code = NotFound desc = could not find container \"8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb\": container with ID starting with 8191ca51eb3c8b3c8f7c3b0e218d2ce70dcd7d162eeb13b8bd77b1c9215fe9cb not found: ID does not exist"
Jul 20 22:52:20.177935 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.177913    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"]
Jul 20 22:52:20.182689 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:20.182669    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-258bd95d-openshift-default-5b79f99495-9m8kn"]
Jul 20 22:52:21.168098 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:21.168064    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" path="/var/lib/kubelet/pods/6d52ca4d-c5fe-49e6-aac5-62b106895664/volumes"
Jul 20 22:52:23.703454 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:23.703409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:23.767036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:23.766991    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:23.845594 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:23.845559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:23.943160 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:23.943121    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:24.044404 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:24.044321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:24.402302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:24.402266    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:50.363576 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:50.363533    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:56.806436 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:56.806391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:56.922127 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:56.922027    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:52:57.008317 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:52:57.008276    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:12.915909 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:12.915873    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:18.956819 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:18.956773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:19.026569 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:19.026539    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:19.117394 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:19.117350    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:19.223347 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:19.223241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:29.714070 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:29.714034    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:30.514919 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:30.514888    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:37.546560 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:37.546525    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:37.649956 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:37.649923    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:37.753839 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:37.753801    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:37.851079 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:37.851039    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:38.681189 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:38.681135    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:38.765812 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:38.765766    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:38.865550 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:38.865518    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:40.504412 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:40.504373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:46.434288 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:46.434252    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:46.512102 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:46.512068    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:47.199516 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:47.199483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:54.081326 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.081284    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:54.213879 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.213841    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:54.367072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.366981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:54.631790 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.631709    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"]
Jul 20 22:53:54.632044 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.632032    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy"
Jul 20 22:53:54.632088 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.632046    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy"
Jul 20 22:53:54.632088 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.632057    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4163d86e-9229-49f3-b19b-f24107279b92" containerName="maas-api"
Jul 20 22:53:54.632088 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.632063    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4163d86e-9229-49f3-b19b-f24107279b92" containerName="maas-api"
Jul 20 22:53:54.632183 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.632123    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy"
Jul 20 22:53:54.632183 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.632134    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4163d86e-9229-49f3-b19b-f24107279b92" containerName="maas-api"
Jul 20 22:53:54.634944 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.634927    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.637166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.637147    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 22:53:54.637261 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.637195    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-25f24b58-openshift-default-dockercfg-clb7k\""
Jul 20 22:53:54.656739 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.656712    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"]
Jul 20 22:53:54.662923 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.662890    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:54.761664 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-data\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.761891 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761678    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-podinfo\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.761891 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761732    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-credential-socket\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.761891 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-certs\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.761891 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-envoy\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.761891 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761854    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55vsb\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-kube-api-access-55vsb\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.761891 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761880    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-token\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.762128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761955    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-socket\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.762128 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.761993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istiod-ca-cert\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863169 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863128    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-envoy\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55vsb\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-kube-api-access-55vsb\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-token\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863242    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-socket\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istiod-ca-cert\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863310    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-data\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-podinfo\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863664 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-credential-socket\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863664 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-certs\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863664 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863617    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-socket\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.863854 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.863832    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-certs\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.864328 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.864299    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istiod-ca-cert\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.864455 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.864329    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-data\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.864455 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.864309    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-credential-socket\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.865570 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.865552    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-envoy\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.866150 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.866125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-podinfo\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.871475 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.871449    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55vsb\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-kube-api-access-55vsb\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.871628 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.871610    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-token\") pod \"e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") " pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:54.944621 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:54.944532    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:55.087289 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.087254    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:55.107403 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.107371    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"]
Jul 20 22:53:55.110620 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:53:55.110599    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaab798f_14e5_4fd0_9eb5_5e8c7846e230.slice/crio-8bc5720737e578582458c3a09e735ece5f6eeec9e1c2b463540790e3a3f32b91 WatchSource:0}: Error finding container 8bc5720737e578582458c3a09e735ece5f6eeec9e1c2b463540790e3a3f32b91: Status 404 returned error can't find the container with id 8bc5720737e578582458c3a09e735ece5f6eeec9e1c2b463540790e3a3f32b91
Jul 20 22:53:55.112720 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.112667    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:53:55.112824 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.112746    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:53:55.112824 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.112779    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:53:55.547508 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.547470    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" event={"ID":"eaab798f-14e5-4fd0-9eb5-5e8c7846e230","Type":"ContainerStarted","Data":"9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08"}
Jul 20 22:53:55.547687 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.547532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" event={"ID":"eaab798f-14e5-4fd0-9eb5-5e8c7846e230","Type":"ContainerStarted","Data":"8bc5720737e578582458c3a09e735ece5f6eeec9e1c2b463540790e3a3f32b91"}
Jul 20 22:53:55.568373 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.568318    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" podStartSLOduration=1.568300193 podStartE2EDuration="1.568300193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:53:55.566785616 +0000 UTC m=+1856.958040811" watchObservedRunningTime="2026-07-20 22:53:55.568300193 +0000 UTC m=+1856.959555388"
Jul 20 22:53:55.944809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:55.944754    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:56.949534 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:56.949508    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:57.467499 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.467456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:57.556321 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.556284    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:57.557200 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.557181    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:53:57.566739 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.566682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:57.709455 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.709423    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"]
Jul 20 22:53:57.709756 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.709742    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy"
Jul 20 22:53:57.709816 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.709758    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy"
Jul 20 22:53:57.709850 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.709820    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d52ca4d-c5fe-49e6-aac5-62b106895664" containerName="istio-proxy"
Jul 20 22:53:57.712767 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.712749    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:57.714913 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.714895    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-25f24b58-serving-cert\""
Jul 20 22:53:57.715123 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.715104    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 22:53:57.715175 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.715111    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:53:57.715175 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.715157    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 22:53:57.721729 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.721708    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"]
Jul 20 22:53:57.745431 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.745399    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:57.791130 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.791097    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:57.791303 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.791144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5c78\" (UniqueName: \"kubernetes.io/projected/187740e2-fc09-46ac-87db-fb29a30e83d2-kube-api-access-q5c78\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:57.791303 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.791225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/187740e2-fc09-46ac-87db-fb29a30e83d2-openshift-service-ca\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:57.892036 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.891998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:57.892233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.892046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5c78\" (UniqueName: \"kubernetes.io/projected/187740e2-fc09-46ac-87db-fb29a30e83d2-kube-api-access-q5c78\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:57.892233 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.892074    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/187740e2-fc09-46ac-87db-fb29a30e83d2-openshift-service-ca\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:57.892233 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:53:57.892148    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-serving-cert: secret "maas-api-e2e-mt-25f24b58-serving-cert" not found
Jul 20 22:53:57.892233 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:53:57.892217    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls podName:187740e2-fc09-46ac-87db-fb29a30e83d2 nodeName:}" failed. No retries permitted until 2026-07-20 22:53:58.392197194 +0000 UTC m=+1859.783452373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls") pod "maas-api-e2e-mt-25f24b58-97779999d-tpnb2" (UID: "187740e2-fc09-46ac-87db-fb29a30e83d2") : secret "maas-api-e2e-mt-25f24b58-serving-cert" not found
Jul 20 22:53:57.892671 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.892651    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/187740e2-fc09-46ac-87db-fb29a30e83d2-openshift-service-ca\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:57.901920 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:57.901899    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5c78\" (UniqueName: \"kubernetes.io/projected/187740e2-fc09-46ac-87db-fb29a30e83d2-kube-api-access-q5c78\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:58.338950 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:58.338910    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:58.395436 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:58.395402    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:58.395601 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:53:58.395519    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-serving-cert: secret "maas-api-e2e-mt-25f24b58-serving-cert" not found
Jul 20 22:53:58.395601 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:53:58.395571    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls podName:187740e2-fc09-46ac-87db-fb29a30e83d2 nodeName:}" failed. No retries permitted until 2026-07-20 22:53:59.395557165 +0000 UTC m=+1860.786812338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls") pod "maas-api-e2e-mt-25f24b58-97779999d-tpnb2" (UID: "187740e2-fc09-46ac-87db-fb29a30e83d2") : secret "maas-api-e2e-mt-25f24b58-serving-cert" not found
Jul 20 22:53:58.436972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:58.436931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:58.579505 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:58.579467    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:53:59.407884 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:59.407835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:59.410218 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:59.410195    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls\") pod \"maas-api-e2e-mt-25f24b58-97779999d-tpnb2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:59.525337 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:59.525306    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 22:53:59.533518 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:59.533497    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:53:59.661438 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:53:59.661376    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"]
Jul 20 22:53:59.664467 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:53:59.664436    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187740e2_fc09_46ac_87db_fb29a30e83d2.slice/crio-f41e5c5db086391f98a2cfce104a27ec604d058d5035e81110c6fc247c0efeb9 WatchSource:0}: Error finding container f41e5c5db086391f98a2cfce104a27ec604d058d5035e81110c6fc247c0efeb9: Status 404 returned error can't find the container with id f41e5c5db086391f98a2cfce104a27ec604d058d5035e81110c6fc247c0efeb9
Jul 20 22:54:00.570919 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:00.570883    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2" event={"ID":"187740e2-fc09-46ac-87db-fb29a30e83d2","Type":"ContainerStarted","Data":"ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8"}
Jul 20 22:54:00.571381 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:00.570937    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2" event={"ID":"187740e2-fc09-46ac-87db-fb29a30e83d2","Type":"ContainerStarted","Data":"f41e5c5db086391f98a2cfce104a27ec604d058d5035e81110c6fc247c0efeb9"}
Jul 20 22:54:00.571381 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:00.570965    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:54:00.600474 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:00.600423    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2" podStartSLOduration=3.126451614 podStartE2EDuration="3.600408184s" totalImagesPullingTime="473.95657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:54:00.598601197 +0000 UTC m=+1861.989856394" watchObservedRunningTime="2026-07-20 22:54:00.600408184 +0000 UTC m=+1861.991663380"
Jul 20 22:54:01.969422 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:01.969381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:02.672651 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:02.672610    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:02.770567 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:02.770530    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:03.073774 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:03.073736    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:06.582821 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:06.582791    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:54:09.023165 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:09.023074    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:09.126107 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:09.126018    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:09.622247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:09.622217    2572 generic.go:356] "Generic (PLEG): container finished" podID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerID="9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08" exitCode=0
Jul 20 22:54:09.622429 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:09.622290    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" event={"ID":"eaab798f-14e5-4fd0-9eb5-5e8c7846e230","Type":"ContainerDied","Data":"9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08"}
Jul 20 22:54:09.622663 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:09.622649    2572 scope.go:117] "RemoveContainer" containerID="9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08"
Jul 20 22:54:09.623686 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:09.623657    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:54:09.623777 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:09.623759    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:54:09.623821 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:09.623808    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:54:10.494039 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:10.493986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:10.558261 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:10.558226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:10.629125 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:10.629086    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" event={"ID":"eaab798f-14e5-4fd0-9eb5-5e8c7846e230","Type":"ContainerStarted","Data":"16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693"}
Jul 20 22:54:10.945035 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:10.944987    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:54:10.946254 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:10.946224    2572 patch_prober.go:28] interesting pod/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 20 22:54:10.946367 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:10.946278    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 20 22:54:11.945418 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:11.945379    2572 patch_prober.go:28] interesting pod/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 20 22:54:11.945834 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:11.945437    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 20 22:54:12.556528 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:12.556482    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:54:12.945988 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:12.945893    2572 patch_prober.go:28] interesting pod/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 20 22:54:12.945988 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:12.945971    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 20 22:54:13.945757 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:13.945687    2572 patch_prober.go:28] interesting pod/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 20 22:54:13.945934 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:13.945774    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 20 22:54:14.949368 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:14.949337    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:54:14.950308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:14.950290    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:54:19.815373 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:19.815344    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"]
Jul 20 22:54:19.815817 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:19.815546    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2" podUID="187740e2-fc09-46ac-87db-fb29a30e83d2" containerName="maas-api" containerID="cri-o://ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8" gracePeriod=30
Jul 20 22:54:19.852559 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:19.852498    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:20.059205 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.059178    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:54:20.081868 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.081777    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls\") pod \"187740e2-fc09-46ac-87db-fb29a30e83d2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") "
Jul 20 22:54:20.081868 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.081850    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/187740e2-fc09-46ac-87db-fb29a30e83d2-openshift-service-ca\") pod \"187740e2-fc09-46ac-87db-fb29a30e83d2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") "
Jul 20 22:54:20.082082 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.081884    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5c78\" (UniqueName: \"kubernetes.io/projected/187740e2-fc09-46ac-87db-fb29a30e83d2-kube-api-access-q5c78\") pod \"187740e2-fc09-46ac-87db-fb29a30e83d2\" (UID: \"187740e2-fc09-46ac-87db-fb29a30e83d2\") "
Jul 20 22:54:20.082302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.082278    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/187740e2-fc09-46ac-87db-fb29a30e83d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "187740e2-fc09-46ac-87db-fb29a30e83d2" (UID: "187740e2-fc09-46ac-87db-fb29a30e83d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:54:20.084112 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.084086    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/187740e2-fc09-46ac-87db-fb29a30e83d2-kube-api-access-q5c78" (OuterVolumeSpecName: "kube-api-access-q5c78") pod "187740e2-fc09-46ac-87db-fb29a30e83d2" (UID: "187740e2-fc09-46ac-87db-fb29a30e83d2"). InnerVolumeSpecName "kube-api-access-q5c78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:54:20.084345 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.084325    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "187740e2-fc09-46ac-87db-fb29a30e83d2" (UID: "187740e2-fc09-46ac-87db-fb29a30e83d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:54:20.182720 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.182665    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/187740e2-fc09-46ac-87db-fb29a30e83d2-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:20.182720 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.182708    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5c78\" (UniqueName: \"kubernetes.io/projected/187740e2-fc09-46ac-87db-fb29a30e83d2-kube-api-access-q5c78\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:20.182720 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.182722    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/187740e2-fc09-46ac-87db-fb29a30e83d2-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:20.672496 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.672457    2572 generic.go:356] "Generic (PLEG): container finished" podID="187740e2-fc09-46ac-87db-fb29a30e83d2" containerID="ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8" exitCode=0
Jul 20 22:54:20.672496 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.672498    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"
Jul 20 22:54:20.672781 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.672532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2" event={"ID":"187740e2-fc09-46ac-87db-fb29a30e83d2","Type":"ContainerDied","Data":"ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8"}
Jul 20 22:54:20.672781 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.672578    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2" event={"ID":"187740e2-fc09-46ac-87db-fb29a30e83d2","Type":"ContainerDied","Data":"f41e5c5db086391f98a2cfce104a27ec604d058d5035e81110c6fc247c0efeb9"}
Jul 20 22:54:20.672781 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.672605    2572 scope.go:117] "RemoveContainer" containerID="ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8"
Jul 20 22:54:20.680922 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.680900    2572 scope.go:117] "RemoveContainer" containerID="ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8"
Jul 20 22:54:20.681213 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:54:20.681190    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8\": container with ID starting with ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8 not found: ID does not exist" containerID="ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8"
Jul 20 22:54:20.681280 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.681223    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8"} err="failed to get container status \"ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8\": rpc error: code = NotFound desc = could not find container \"ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8\": container with ID starting with ec7f0bce87afc1b860d3cf42d3d8b8f8b081bd313c2707b2360c702085afa6f8 not found: ID does not exist"
Jul 20 22:54:20.695366 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.695334    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"]
Jul 20 22:54:20.697405 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:20.697385    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-25f24b58-97779999d-tpnb2"]
Jul 20 22:54:21.168187 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:21.168150    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="187740e2-fc09-46ac-87db-fb29a30e83d2" path="/var/lib/kubelet/pods/187740e2-fc09-46ac-87db-fb29a30e83d2/volumes"
Jul 20 22:54:24.463237 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:24.463200    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:24.901671 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:24.901637    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:30.938141 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:30.938100    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:31.003968 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:31.003918    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:31.190850 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:31.190766    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"]
Jul 20 22:54:31.190997 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:31.190966    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy" containerID="cri-o://16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693" gracePeriod=30
Jul 20 22:54:31.205748 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:31.205718    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:31.434457 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:31.434420    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:31.558634 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:31.558606    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:31.675625 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:31.675590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:31.839301 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:31.839214    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:36.434681 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.434659    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:54:36.526952 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.526854    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-token\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.526952 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.526904    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-certs\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.526952 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.526928    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-envoy\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.527223 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527106    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55vsb\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-kube-api-access-55vsb\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.527223 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527163    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-socket\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.527223 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527209    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-data\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.527442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527222    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:54:36.527442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527261    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-credential-socket\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.527442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527318    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-podinfo\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.527442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527354    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istiod-ca-cert\") pod \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\" (UID: \"eaab798f-14e5-4fd0-9eb5-5e8c7846e230\") "
Jul 20 22:54:36.527442 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527429    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:54:36.527720 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527606    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.527720 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527626    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-workload-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.527827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527760    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:54:36.527827 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.527765    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:54:36.528210 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.528180    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-data" (OuterVolumeSpecName: "istio-data") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:54:36.529300 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.529270    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:54:36.529408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.529301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-kube-api-access-55vsb" (OuterVolumeSpecName: "kube-api-access-55vsb") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "kube-api-access-55vsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:54:36.529408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.529349    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 22:54:36.529408 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.529365    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-token" (OuterVolumeSpecName: "istio-token") pod "eaab798f-14e5-4fd0-9eb5-5e8c7846e230" (UID: "eaab798f-14e5-4fd0-9eb5-5e8c7846e230"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:54:36.628021 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.627981    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55vsb\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-kube-api-access-55vsb\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.628021 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.628014    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-data\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.628021 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.628023    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-credential-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.628021 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.628032    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-podinfo\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.628271 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.628040    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istiod-ca-cert\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.628271 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.628048    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-token\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.628271 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.628055    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eaab798f-14e5-4fd0-9eb5-5e8c7846e230-istio-envoy\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:54:36.738616 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.738584    2572 generic.go:356] "Generic (PLEG): container finished" podID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerID="16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693" exitCode=0
Jul 20 22:54:36.738801 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.738635    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"
Jul 20 22:54:36.738801 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.738648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" event={"ID":"eaab798f-14e5-4fd0-9eb5-5e8c7846e230","Type":"ContainerDied","Data":"16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693"}
Jul 20 22:54:36.738801 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.738711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42" event={"ID":"eaab798f-14e5-4fd0-9eb5-5e8c7846e230","Type":"ContainerDied","Data":"8bc5720737e578582458c3a09e735ece5f6eeec9e1c2b463540790e3a3f32b91"}
Jul 20 22:54:36.738801 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.738720    2572 scope.go:117] "RemoveContainer" containerID="16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693"
Jul 20 22:54:36.748993 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.748819    2572 scope.go:117] "RemoveContainer" containerID="9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08"
Jul 20 22:54:36.756506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.756487    2572 scope.go:117] "RemoveContainer" containerID="16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693"
Jul 20 22:54:36.756790 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:54:36.756772    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693\": container with ID starting with 16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693 not found: ID does not exist" containerID="16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693"
Jul 20 22:54:36.756847 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.756798    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693"} err="failed to get container status \"16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693\": rpc error: code = NotFound desc = could not find container \"16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693\": container with ID starting with 16309092f62c291bcbac1b1986504131fd139e07c67b56fee3e3d9a791d8d693 not found: ID does not exist"
Jul 20 22:54:36.756847 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.756817    2572 scope.go:117] "RemoveContainer" containerID="9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08"
Jul 20 22:54:36.757037 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:54:36.757018    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08\": container with ID starting with 9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08 not found: ID does not exist" containerID="9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08"
Jul 20 22:54:36.757090 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.757043    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08"} err="failed to get container status \"9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08\": rpc error: code = NotFound desc = could not find container \"9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08\": container with ID starting with 9ff27cacd4e6613ee0275bddd67bc8f061209302f726fc9d4f3f2519801b6b08 not found: ID does not exist"
Jul 20 22:54:36.762936 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.762914    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"]
Jul 20 22:54:36.771586 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:36.771564    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-25f24b58-openshift-default-6cc88d68bc-zrl42"]
Jul 20 22:54:37.169227 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:37.169199    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" path="/var/lib/kubelet/pods/eaab798f-14e5-4fd0-9eb5-5e8c7846e230/volumes"
Jul 20 22:54:37.735328 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:37.735287    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:37.817361 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:37.817331    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:37.899069 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:37.899027    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:38.074681 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:38.074636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:43.983200 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:43.983167    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:44.043573 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:44.043541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:50.773045 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:50.773009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:51.060305 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060275    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"]
Jul 20 22:54:51.060595 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060582    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy"
Jul 20 22:54:51.060643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060597    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy"
Jul 20 22:54:51.060643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060608    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy"
Jul 20 22:54:51.060643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060614    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy"
Jul 20 22:54:51.060643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060622    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="187740e2-fc09-46ac-87db-fb29a30e83d2" containerName="maas-api"
Jul 20 22:54:51.060643 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060627    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="187740e2-fc09-46ac-87db-fb29a30e83d2" containerName="maas-api"
Jul 20 22:54:51.060822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060677    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy"
Jul 20 22:54:51.060822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060684    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="187740e2-fc09-46ac-87db-fb29a30e83d2" containerName="maas-api"
Jul 20 22:54:51.060822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.060705    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaab798f-14e5-4fd0-9eb5-5e8c7846e230" containerName="istio-proxy"
Jul 20 22:54:51.065150 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.065126    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.067601 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.067580    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 22:54:51.067757 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.067633    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5a8fe08b-openshift-default-dockercfg-mg8mk\""
Jul 20 22:54:51.079877 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.079853    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"]
Jul 20 22:54:51.090136 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.090097    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:51.150899 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.150865    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-data\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.151066 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.150903    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-podinfo\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.151066 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.150933    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-credential-socket\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.151066 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.151009    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-certs\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.151066 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.151043    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-envoy\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.151066 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.151063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjbbx\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-kube-api-access-mjbbx\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.151228 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.151116    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-token\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.151228 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.151148    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-socket\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.151228 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.151171    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istiod-ca-cert\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.201665 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.201631    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:51.252295 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252264    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-data\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252494 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-podinfo\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252494 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-credential-socket\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252494 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252409    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-certs\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252494 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252433    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-envoy\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252494 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjbbx\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-kube-api-access-mjbbx\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252494 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-token\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252897 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-socket\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252897 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istiod-ca-cert\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252897 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252734    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-credential-socket\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.252897 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252753    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-data\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.253109 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.252982    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-socket\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.253415 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.253246    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istiod-ca-cert\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.253415 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.253299    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-certs\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.255006 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.254977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-envoy\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.255296 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.255269    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-podinfo\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.262290 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.262265    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjbbx\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-kube-api-access-mjbbx\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.262412 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.262348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-token\") pod \"e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") " pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.375177 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.375078    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:51.506099 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.506064    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"]
Jul 20 22:54:51.508426 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:54:51.508403    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafdadd88_fc8a_41f4_a0de_dcbed1c57c1a.slice/crio-291f01dbf6b3771f68ad5b0fab6cc8f57630ccf4b8d5864dfdad33f1f544828e WatchSource:0}: Error finding container 291f01dbf6b3771f68ad5b0fab6cc8f57630ccf4b8d5864dfdad33f1f544828e: Status 404 returned error can't find the container with id 291f01dbf6b3771f68ad5b0fab6cc8f57630ccf4b8d5864dfdad33f1f544828e
Jul 20 22:54:51.510400 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.510360    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:54:51.510469 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.510430    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:54:51.510469 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.510464    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:54:51.805283 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.805252    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" event={"ID":"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a","Type":"ContainerStarted","Data":"455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab"}
Jul 20 22:54:51.805642 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.805301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" event={"ID":"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a","Type":"ContainerStarted","Data":"291f01dbf6b3771f68ad5b0fab6cc8f57630ccf4b8d5864dfdad33f1f544828e"}
Jul 20 22:54:51.824739 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:51.824673    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" podStartSLOduration=0.824657712 podStartE2EDuration="824.657712ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:54:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:54:51.823423645 +0000 UTC m=+1913.214678839" watchObservedRunningTime="2026-07-20 22:54:51.824657712 +0000 UTC m=+1913.215912908"
Jul 20 22:54:52.375714 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:52.375671    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:52.380725 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:52.380684    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:52.809328 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:52.809299    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:52.810308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:52.810284    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:54:53.742983 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.742949    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:53.821948 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.821919    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"]
Jul 20 22:54:53.825080 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.825057    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:53.828035 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.828012    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:54:53.828192 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.828173    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 22:54:53.828771 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.828753    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5a8fe08b-serving-cert\""
Jul 20 22:54:53.828854 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.828755    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 22:54:53.841201 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.841183    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"]
Jul 20 22:54:53.850980 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.850953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:53.942335 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.942297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:53.976302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.976271    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:53.976302 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.976301    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-openshift-service-ca\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:53.976536 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:53.976370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj942\" (UniqueName: \"kubernetes.io/projected/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-kube-api-access-vj942\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.077123 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.077089    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.077123 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.077123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-openshift-service-ca\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.077373 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.077174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj942\" (UniqueName: \"kubernetes.io/projected/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-kube-api-access-vj942\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.077373 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:54:54.077242    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-serving-cert: secret "maas-api-e2e-mt-5a8fe08b-serving-cert" not found
Jul 20 22:54:54.077373 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:54:54.077303    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls podName:9fa6e5b5-7503-443c-8a2d-37ec9e8aa543 nodeName:}" failed. No retries permitted until 2026-07-20 22:54:54.577286983 +0000 UTC m=+1915.968542159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls") pod "maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g" (UID: "9fa6e5b5-7503-443c-8a2d-37ec9e8aa543") : secret "maas-api-e2e-mt-5a8fe08b-serving-cert" not found
Jul 20 22:54:54.077809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.077793    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-openshift-service-ca\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.089041 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.089016    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj942\" (UniqueName: \"kubernetes.io/projected/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-kube-api-access-vj942\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.126279 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.126251    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:54.508988 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.508903    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:54.580676 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.580624    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.583134 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.583109    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls\") pod \"maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.606957 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.606921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:54:54.736160 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.736123    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:54.868060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:54.868035    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"]
Jul 20 22:54:54.871095 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:54:54.871066    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa6e5b5_7503_443c_8a2d_37ec9e8aa543.slice/crio-6952b885db7dd693cb588f46677482f2509a8c4e3871eef4d01a5f9b1e2b0f67 WatchSource:0}: Error finding container 6952b885db7dd693cb588f46677482f2509a8c4e3871eef4d01a5f9b1e2b0f67: Status 404 returned error can't find the container with id 6952b885db7dd693cb588f46677482f2509a8c4e3871eef4d01a5f9b1e2b0f67
Jul 20 22:54:55.823945 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:55.823899    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g" event={"ID":"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543","Type":"ContainerStarted","Data":"f79137813e49187142b31303a738f8125a97b516be9e8ff44471797bcea62137"}
Jul 20 22:54:55.824147 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:55.823977    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g" event={"ID":"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543","Type":"ContainerStarted","Data":"6952b885db7dd693cb588f46677482f2509a8c4e3871eef4d01a5f9b1e2b0f67"}
Jul 20 22:54:55.824147 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:55.824034    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:54:55.841672 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:55.841618    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g" podStartSLOduration=2.52042225 podStartE2EDuration="2.841604119s" totalImagesPullingTime="321.181869ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:54:55.840151722 +0000 UTC m=+1917.231406929" watchObservedRunningTime="2026-07-20 22:54:55.841604119 +0000 UTC m=+1917.232859314"
Jul 20 22:54:58.240948 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:54:58.240909    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:01.833795 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:01.833763    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:55:02.199368 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.199289    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"]
Jul 20 22:55:02.202804 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.202775    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.205339 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.205315    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5a8fe08b\"/\"default-dockercfg-77j64\""
Jul 20 22:55:02.205558 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.205542    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5a8fe08b\"/\"openshift-service-ca.crt\""
Jul 20 22:55:02.206172 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.206154    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-5a8fe08b\"/\"e2e-lifecycle-model-5a8fe08b-kserve-self-signed-certs\""
Jul 20 22:55:02.206471 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.206451    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-5a8fe08b\"/\"kube-root-ca.crt\""
Jul 20 22:55:02.211155 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.211132    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"]
Jul 20 22:55:02.226289 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.226251    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:02.349870 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.349832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-dshm\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.350049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.349889    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-model-cache\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.350049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.349918    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26362c05-33a6-4525-98cc-ad340e285422-tls-certs\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.350049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.349947    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-home\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.350049 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.350018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pktcw\" (UniqueName: \"kubernetes.io/projected/26362c05-33a6-4525-98cc-ad340e285422-kube-api-access-pktcw\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.350182 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.350108    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-tmp-dir\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451022 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.450922    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-tmp-dir\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451022 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.450976    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-dshm\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451022 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.450999    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-model-cache\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451022 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.451016    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26362c05-33a6-4525-98cc-ad340e285422-tls-certs\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451353 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.451035    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-home\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451353 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.451061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pktcw\" (UniqueName: \"kubernetes.io/projected/26362c05-33a6-4525-98cc-ad340e285422-kube-api-access-pktcw\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451446 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.451354    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-tmp-dir\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451446 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.451393    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-model-cache\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.451538 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.451503    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-home\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.453474 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.453447    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-dshm\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.454773 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.454752    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26362c05-33a6-4525-98cc-ad340e285422-tls-certs\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.469717 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.462017    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pktcw\" (UniqueName: \"kubernetes.io/projected/26362c05-33a6-4525-98cc-ad340e285422-kube-api-access-pktcw\") pod \"e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") " pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.513308 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.513268    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:02.674954 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.674929    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"]
Jul 20 22:55:02.676947 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:55:02.676918    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26362c05_33a6_4525_98cc_ad340e285422.slice/crio-af6af562c75f5848088f92162cfa0771908d852e3e0766c23d0fc9c6a46ad1b3 WatchSource:0}: Error finding container af6af562c75f5848088f92162cfa0771908d852e3e0766c23d0fc9c6a46ad1b3: Status 404 returned error can't find the container with id af6af562c75f5848088f92162cfa0771908d852e3e0766c23d0fc9c6a46ad1b3
Jul 20 22:55:02.854006 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.853972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp" event={"ID":"26362c05-33a6-4525-98cc-ad340e285422","Type":"ContainerStarted","Data":"9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3"}
Jul 20 22:55:02.854452 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.854014    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp" event={"ID":"26362c05-33a6-4525-98cc-ad340e285422","Type":"ContainerStarted","Data":"af6af562c75f5848088f92162cfa0771908d852e3e0766c23d0fc9c6a46ad1b3"}
Jul 20 22:55:02.873975 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:02.873919    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp" podStartSLOduration=0.87390417 podStartE2EDuration="873.90417ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:55:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:55:02.87228465 +0000 UTC m=+1924.263539843" watchObservedRunningTime="2026-07-20 22:55:02.87390417 +0000 UTC m=+1924.265159365"
Jul 20 22:55:05.869809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:05.869772    2572 generic.go:356] "Generic (PLEG): container finished" podID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerID="455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab" exitCode=0
Jul 20 22:55:05.870261 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:05.869826    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" event={"ID":"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a","Type":"ContainerDied","Data":"455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab"}
Jul 20 22:55:05.870261 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:05.870189    2572 scope.go:117] "RemoveContainer" containerID="455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab"
Jul 20 22:55:05.871215 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:05.871185    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:55:05.871288 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:05.871253    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:55:05.871288 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:05.871282    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:55:06.878336 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:06.878294    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" event={"ID":"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a","Type":"ContainerStarted","Data":"a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4"}
Jul 20 22:55:07.379144 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:07.379059    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:55:07.383153 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:07.382820    2572 patch_prober.go:28] interesting pod/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 20 22:55:07.383153 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:07.382886    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 20 22:55:07.809870 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:07.809833    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:55:08.375838 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:08.375799    2572 patch_prober.go:28] interesting pod/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 20 22:55:08.376499 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:08.376443    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 20 22:55:09.375754 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:09.375717    2572 patch_prober.go:28] interesting pod/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 20 22:55:09.376103 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:09.376067    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 20 22:55:10.375824 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:10.375781    2572 patch_prober.go:28] interesting pod/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 20 22:55:10.376068 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:10.375854    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 20 22:55:11.380026 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:11.379995    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:55:11.381084 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:11.381062    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:55:12.513879 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:12.513840    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:12.513879 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:12.513890    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:12.526016 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:12.525982    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:12.927137 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:12.927112    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:55:17.804572 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:17.804536    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:19.005394 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:19.005347    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:36.888959 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:36.888927    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"]
Jul 20 22:55:36.889535 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:36.889130    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g" podUID="9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" containerName="maas-api" containerID="cri-o://f79137813e49187142b31303a738f8125a97b516be9e8ff44471797bcea62137" gracePeriod=30
Jul 20 22:55:36.925098 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:36.925073    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:37.020538 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.020455    2572 generic.go:356] "Generic (PLEG): container finished" podID="9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" containerID="f79137813e49187142b31303a738f8125a97b516be9e8ff44471797bcea62137" exitCode=0
Jul 20 22:55:37.020794 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.020536    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g" event={"ID":"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543","Type":"ContainerDied","Data":"f79137813e49187142b31303a738f8125a97b516be9e8ff44471797bcea62137"}
Jul 20 22:55:37.130449 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.130424    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:55:37.250820 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.250723    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-openshift-service-ca\") pod \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") "
Jul 20 22:55:37.250820 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.250801    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls\") pod \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") "
Jul 20 22:55:37.251041 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.250894    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj942\" (UniqueName: \"kubernetes.io/projected/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-kube-api-access-vj942\") pod \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\" (UID: \"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543\") "
Jul 20 22:55:37.251113 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.251082    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" (UID: "9fa6e5b5-7503-443c-8a2d-37ec9e8aa543"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:55:37.252851 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.252818    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-kube-api-access-vj942" (OuterVolumeSpecName: "kube-api-access-vj942") pod "9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" (UID: "9fa6e5b5-7503-443c-8a2d-37ec9e8aa543"). InnerVolumeSpecName "kube-api-access-vj942". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:55:37.252972 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.252859    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" (UID: "9fa6e5b5-7503-443c-8a2d-37ec9e8aa543"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:55:37.352056 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.352015    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:55:37.352056 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.352049    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:55:37.352056 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:37.352059    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj942\" (UniqueName: \"kubernetes.io/projected/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543-kube-api-access-vj942\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:55:38.026172 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:38.026143    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"
Jul 20 22:55:38.026172 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:38.026157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g" event={"ID":"9fa6e5b5-7503-443c-8a2d-37ec9e8aa543","Type":"ContainerDied","Data":"6952b885db7dd693cb588f46677482f2509a8c4e3871eef4d01a5f9b1e2b0f67"}
Jul 20 22:55:38.026688 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:38.026210    2572 scope.go:117] "RemoveContainer" containerID="f79137813e49187142b31303a738f8125a97b516be9e8ff44471797bcea62137"
Jul 20 22:55:38.047346 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:38.047322    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"]
Jul 20 22:55:38.052108 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:38.052086    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5a8fe08b-5f85dbfc9f-bw82g"]
Jul 20 22:55:39.169934 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:39.169898    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" path="/var/lib/kubelet/pods/9fa6e5b5-7503-443c-8a2d-37ec9e8aa543/volumes"
Jul 20 22:55:41.447362 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:41.447333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:43.621132 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:43.621078    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:48.605072 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:48.605035    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"]
Jul 20 22:55:48.718760 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:48.718731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:49.198298 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:49.198256    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:55:59.210501 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:55:59.210430    2572 scope.go:117] "RemoveContainer" containerID="5a658b30183d4dca94299e43cf5d147e89c6ebf47d12e2cc66030bdf5e3ec361"
Jul 20 22:56:03.624433 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.624362    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp" podUID="26362c05-33a6-4525-98cc-ad340e285422" containerName="main" containerID="cri-o://9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3" gracePeriod=45
Jul 20 22:56:03.867400 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.867376    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:56:03.977361 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977270    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-home\") pod \"26362c05-33a6-4525-98cc-ad340e285422\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") "
Jul 20 22:56:03.977361 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977319    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-model-cache\") pod \"26362c05-33a6-4525-98cc-ad340e285422\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") "
Jul 20 22:56:03.977583 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977386    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26362c05-33a6-4525-98cc-ad340e285422-tls-certs\") pod \"26362c05-33a6-4525-98cc-ad340e285422\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") "
Jul 20 22:56:03.977583 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977432    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-dshm\") pod \"26362c05-33a6-4525-98cc-ad340e285422\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") "
Jul 20 22:56:03.977583 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977455    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-tmp-dir\") pod \"26362c05-33a6-4525-98cc-ad340e285422\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") "
Jul 20 22:56:03.977583 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977485    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pktcw\" (UniqueName: \"kubernetes.io/projected/26362c05-33a6-4525-98cc-ad340e285422-kube-api-access-pktcw\") pod \"26362c05-33a6-4525-98cc-ad340e285422\" (UID: \"26362c05-33a6-4525-98cc-ad340e285422\") "
Jul 20 22:56:03.977583 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977520    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-home" (OuterVolumeSpecName: "home") pod "26362c05-33a6-4525-98cc-ad340e285422" (UID: "26362c05-33a6-4525-98cc-ad340e285422"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:03.977857 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977639    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-model-cache" (OuterVolumeSpecName: "model-cache") pod "26362c05-33a6-4525-98cc-ad340e285422" (UID: "26362c05-33a6-4525-98cc-ad340e285422"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:03.977857 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977741    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-model-cache\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:03.977857 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977747    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26362c05-33a6-4525-98cc-ad340e285422" (UID: "26362c05-33a6-4525-98cc-ad340e285422"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:03.977857 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.977754    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-home\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:03.979770 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.979743    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-dshm" (OuterVolumeSpecName: "dshm") pod "26362c05-33a6-4525-98cc-ad340e285422" (UID: "26362c05-33a6-4525-98cc-ad340e285422"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:03.979770 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.979744    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26362c05-33a6-4525-98cc-ad340e285422-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26362c05-33a6-4525-98cc-ad340e285422" (UID: "26362c05-33a6-4525-98cc-ad340e285422"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:56:03.979913 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:03.979778    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26362c05-33a6-4525-98cc-ad340e285422-kube-api-access-pktcw" (OuterVolumeSpecName: "kube-api-access-pktcw") pod "26362c05-33a6-4525-98cc-ad340e285422" (UID: "26362c05-33a6-4525-98cc-ad340e285422"). InnerVolumeSpecName "kube-api-access-pktcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:56:04.079071 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.079029    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26362c05-33a6-4525-98cc-ad340e285422-tls-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:04.079071 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.079062    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-dshm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:04.079071 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.079071    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26362c05-33a6-4525-98cc-ad340e285422-tmp-dir\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:04.079071 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.079080    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pktcw\" (UniqueName: \"kubernetes.io/projected/26362c05-33a6-4525-98cc-ad340e285422-kube-api-access-pktcw\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:04.140648 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.140612    2572 generic.go:356] "Generic (PLEG): container finished" podID="26362c05-33a6-4525-98cc-ad340e285422" containerID="9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3" exitCode=0
Jul 20 22:56:04.140809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.140662    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"
Jul 20 22:56:04.140809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.140709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp" event={"ID":"26362c05-33a6-4525-98cc-ad340e285422","Type":"ContainerDied","Data":"9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3"}
Jul 20 22:56:04.140809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.140759    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp" event={"ID":"26362c05-33a6-4525-98cc-ad340e285422","Type":"ContainerDied","Data":"af6af562c75f5848088f92162cfa0771908d852e3e0766c23d0fc9c6a46ad1b3"}
Jul 20 22:56:04.140809 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.140779    2572 scope.go:117] "RemoveContainer" containerID="9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3"
Jul 20 22:56:04.149167 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.149151    2572 scope.go:117] "RemoveContainer" containerID="9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3"
Jul 20 22:56:04.149431 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:56:04.149413    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3\": container with ID starting with 9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3 not found: ID does not exist" containerID="9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3"
Jul 20 22:56:04.149479 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.149445    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3"} err="failed to get container status \"9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3\": rpc error: code = NotFound desc = could not find container \"9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3\": container with ID starting with 9dcf5fa8a56ba00ed65ab4b26566ab770a49570512796da942b1c097d7a4cdf3 not found: ID does not exist"
Jul 20 22:56:04.160428 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.160402    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"]
Jul 20 22:56:04.164283 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:04.164264    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-5a8fe08b/e2e-lifecycle-model-5a8fe08b-kserve-755ff97cdc-8zcmp"]
Jul 20 22:56:05.167896 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:05.167865    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26362c05-33a6-4525-98cc-ad340e285422" path="/var/lib/kubelet/pods/26362c05-33a6-4525-98cc-ad340e285422/volumes"
Jul 20 22:56:24.772899 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:24.772866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:25.913929 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:25.913879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:31.580133 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:31.580094    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:46.107183 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:46.107140    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:46.173082 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:46.173043    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:46.376573 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:46.376486    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"]
Jul 20 22:56:46.376782 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:46.376756    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy" containerID="cri-o://a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4" gracePeriod=30
Jul 20 22:56:46.394978 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:46.394931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:46.640315 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:46.640216    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:47.774521 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:47.774479    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:47.883138 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:47.883099    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:47.986709 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:47.986657    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:48.704589 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:48.704530    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:48.861946 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:48.861912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:48.976468 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:48.976371    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:49.937734 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:49.937672    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:50.040600 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:50.040564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:50.281945 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:50.281861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:51.615709 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.615668    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:56:51.699461 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699359    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-envoy\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.699461 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699419    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istiod-ca-cert\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.699461 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699443    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-data\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.699461 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699464    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-certs\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.699841 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699521    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-credential-socket\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.699841 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699562    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-podinfo\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.699841 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699592    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjbbx\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-kube-api-access-mjbbx\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.699841 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699616    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-socket\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.699841 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699642    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-token\") pod \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\" (UID: \"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a\") "
Jul 20 22:56:51.700155 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699877    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:51.700155 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.699909    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:56:51.700155 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.700027    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istiod-ca-cert\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:51.700155 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.700047    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-credential-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:51.700155 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.700121    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:51.700386 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.700179    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:51.700892 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.700863    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-data" (OuterVolumeSpecName: "istio-data") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:51.701902 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.701880    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:56:51.702057 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.702037    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-kube-api-access-mjbbx" (OuterVolumeSpecName: "kube-api-access-mjbbx") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "kube-api-access-mjbbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:56:51.702238 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.702214    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-token" (OuterVolumeSpecName: "istio-token") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:56:51.702238 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.702218    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" (UID: "afdadd88-fc8a-41f4-a0de-dcbed1c57c1a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 22:56:51.800851 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.800817    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-envoy\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:51.800851 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.800850    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-data\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:51.801068 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.800864    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:51.801068 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.800877    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-podinfo\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:51.801068 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.800890    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjbbx\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-kube-api-access-mjbbx\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:51.801068 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.800904    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-workload-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:51.801068 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:51.800917    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a-istio-token\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:56:52.339808 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.339770    2572 generic.go:356] "Generic (PLEG): container finished" podID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerID="a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4" exitCode=0
Jul 20 22:56:52.339992 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.339822    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"
Jul 20 22:56:52.339992 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.339836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" event={"ID":"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a","Type":"ContainerDied","Data":"a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4"}
Jul 20 22:56:52.339992 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.339888    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl" event={"ID":"afdadd88-fc8a-41f4-a0de-dcbed1c57c1a","Type":"ContainerDied","Data":"291f01dbf6b3771f68ad5b0fab6cc8f57630ccf4b8d5864dfdad33f1f544828e"}
Jul 20 22:56:52.339992 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.339911    2572 scope.go:117] "RemoveContainer" containerID="a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4"
Jul 20 22:56:52.348292 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.348272    2572 scope.go:117] "RemoveContainer" containerID="455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab"
Jul 20 22:56:52.358363 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.358330    2572 scope.go:117] "RemoveContainer" containerID="a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4"
Jul 20 22:56:52.358719 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:56:52.358680    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4\": container with ID starting with a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4 not found: ID does not exist" containerID="a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4"
Jul 20 22:56:52.358859 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.358732    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4"} err="failed to get container status \"a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4\": rpc error: code = NotFound desc = could not find container \"a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4\": container with ID starting with a3c0e8d3967393f9453e4665b7602fa02bdba4bfaf7bf5393aed9fe0a9d83bc4 not found: ID does not exist"
Jul 20 22:56:52.358859 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.358759    2572 scope.go:117] "RemoveContainer" containerID="455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab"
Jul 20 22:56:52.359069 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:56:52.359051    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab\": container with ID starting with 455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab not found: ID does not exist" containerID="455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab"
Jul 20 22:56:52.359112 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.359075    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab"} err="failed to get container status \"455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab\": rpc error: code = NotFound desc = could not find container \"455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab\": container with ID starting with 455af026eeea8034fcd344748423675e5d371a27bd05babc10f97b3242114aab not found: ID does not exist"
Jul 20 22:56:52.359758 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.359740    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"]
Jul 20 22:56:52.363371 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:52.363349    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5a8fe08b-openshift-default-7dff7dc78c-sjjwl"]
Jul 20 22:56:53.169518 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:53.169479    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" path="/var/lib/kubelet/pods/afdadd88-fc8a-41f4-a0de-dcbed1c57c1a/volumes"
Jul 20 22:56:56.251039 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:56.251010    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:56.352822 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:56.352782    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:56.916792 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:56.916756    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:56:59.230170 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:56:59.230139    2572 scope.go:117] "RemoveContainer" containerID="d76cf35eb9f8d771316587078c59ce091b49ed150598956a6e3b7a503dadaafd"
Jul 20 22:57:03.435169 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:03.435128    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:03.507624 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:03.507591    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:03.601167 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:03.601120    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:14.164563 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:14.164520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:14.505430 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:14.505333    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:28.839534 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:28.839448    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:35.460210 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:35.460173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:41.893286 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:41.893254    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:41.961928 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:41.961895    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:42.269246 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.269151    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:42.553647 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.553618    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"]
Jul 20 22:57:42.553954 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.553941    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" containerName="maas-api"
Jul 20 22:57:42.554000 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.553956    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" containerName="maas-api"
Jul 20 22:57:42.554000 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.553970    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26362c05-33a6-4525-98cc-ad340e285422" containerName="main"
Jul 20 22:57:42.554000 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.553975    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="26362c05-33a6-4525-98cc-ad340e285422" containerName="main"
Jul 20 22:57:42.554000 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.553983    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy"
Jul 20 22:57:42.554000 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.553988    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy"
Jul 20 22:57:42.554000 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.553995    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy"
Jul 20 22:57:42.554000 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.554000    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy"
Jul 20 22:57:42.554216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.554059    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa6e5b5-7503-443c-8a2d-37ec9e8aa543" containerName="maas-api"
Jul 20 22:57:42.554216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.554067    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy"
Jul 20 22:57:42.554216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.554073    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="afdadd88-fc8a-41f4-a0de-dcbed1c57c1a" containerName="istio-proxy"
Jul 20 22:57:42.554216 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.554079    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="26362c05-33a6-4525-98cc-ad340e285422" containerName="main"
Jul 20 22:57:42.556956 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.556938    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.559402 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.559383    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a2ebf0-openshift-default-dockercfg-swfc4\""
Jul 20 22:57:42.559501 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.559383    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 22:57:42.571273 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.571244    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"]
Jul 20 22:57:42.578021 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.577996    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:42.626928 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.626896    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-socket\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.627060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.626951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-certs\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.627060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.626979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-podinfo\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.627060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.627005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-token\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.627060 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.627037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjrr7\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-kube-api-access-hjrr7\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.627207 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.627094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-credential-socket\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.627207 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.627119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-data\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.627207 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.627150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-envoy\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.627207 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.627167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istiod-ca-cert\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728083 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-podinfo\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728083 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728085    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-token\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728343 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjrr7\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-kube-api-access-hjrr7\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728343 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728166    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-credential-socket\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728343 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728203    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-data\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728343 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728249    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-envoy\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728343 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728278    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istiod-ca-cert\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728343 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728334    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-socket\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728663 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728395    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-certs\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728732 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728718    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-credential-socket\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728802 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728738    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-socket\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728856 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728827    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-data\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.728905 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.728865    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-certs\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.729247 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.729225    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istiod-ca-cert\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.730720 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.730683    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-envoy\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.730858 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.730839    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-podinfo\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.736073 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.736051    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-token\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.736591 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.736570    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjrr7\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-kube-api-access-hjrr7\") pod \"e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") " pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.739582 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.739558    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:42.866792 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.866669    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:42.996858 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:42.996712    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"]
Jul 20 22:57:42.998988 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:57:42.998960    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7efac2bd_96c2_4d7f_8719_5310ef6b5b6a.slice/crio-06a17231e6057c291a7768a5c9fb35f393ea34eee891f3490f32211c5ee2bbc7 WatchSource:0}: Error finding container 06a17231e6057c291a7768a5c9fb35f393ea34eee891f3490f32211c5ee2bbc7: Status 404 returned error can't find the container with id 06a17231e6057c291a7768a5c9fb35f393ea34eee891f3490f32211c5ee2bbc7
Jul 20 22:57:43.001136 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:43.001096    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:57:43.001223 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:43.001182    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:57:43.001270 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:43.001248    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:57:43.544062 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:43.544026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" event={"ID":"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a","Type":"ContainerStarted","Data":"bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b"}
Jul 20 22:57:43.544256 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:43.544080    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" event={"ID":"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a","Type":"ContainerStarted","Data":"06a17231e6057c291a7768a5c9fb35f393ea34eee891f3490f32211c5ee2bbc7"}
Jul 20 22:57:43.564937 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:43.564884    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" podStartSLOduration=1.564863852 podStartE2EDuration="1.564863852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:57:43.563377959 +0000 UTC m=+2084.954633154" watchObservedRunningTime="2026-07-20 22:57:43.564863852 +0000 UTC m=+2084.956119048"
Jul 20 22:57:43.867322 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:43.867293    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:44.872413 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:44.872388    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:45.474214 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.474180    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:45.551346 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.551319    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:45.552228 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.552205    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:45.584273 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.584229    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:45.707975 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.707923    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"]
Jul 20 22:57:45.711767 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.711747    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.714199 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.714173    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a2ebf0-serving-cert\""
Jul 20 22:57:45.714297 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.714254    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 22:57:45.714366 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.714293    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:57:45.714366 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.714320    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 22:57:45.721482 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.721461    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"]
Jul 20 22:57:45.743496 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.743418    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:45.754564 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.754534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hllf\" (UniqueName: \"kubernetes.io/projected/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-kube-api-access-2hllf\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.754679 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.754571    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.754679 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.754597    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.855608 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.855568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.855824 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.855676    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hllf\" (UniqueName: \"kubernetes.io/projected/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-kube-api-access-2hllf\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.855824 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.855735    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.855824 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:57:45.855752    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-serving-cert: secret "maas-api-e2e-inf-a-a2ebf0-serving-cert" not found
Jul 20 22:57:45.855824 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:57:45.855818    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls podName:b6ad572c-7a3d-44d0-a1d0-65945a6fd875 nodeName:}" failed. No retries permitted until 2026-07-20 22:57:46.355795362 +0000 UTC m=+2087.747050541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls") pod "maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs" (UID: "b6ad572c-7a3d-44d0-a1d0-65945a6fd875") : secret "maas-api-e2e-inf-a-a2ebf0-serving-cert" not found
Jul 20 22:57:45.856390 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.856369    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.864458 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.864425    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hllf\" (UniqueName: \"kubernetes.io/projected/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-kube-api-access-2hllf\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:45.964446 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:45.964398    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:46.344769 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:46.344735    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:46.359835 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:46.359809    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:46.362131 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:46.362108    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls\") pod \"maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:46.444931 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:46.444896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:46.624517 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:46.624440    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:46.749725 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:46.749509    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"]
Jul 20 22:57:46.752471 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:57:46.752447    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ad572c_7a3d_44d0_a1d0_65945a6fd875.slice/crio-41a99c70a6216a69223426520a6b338f31c558208f516b6eeef2fb03fe529f5d WatchSource:0}: Error finding container 41a99c70a6216a69223426520a6b338f31c558208f516b6eeef2fb03fe529f5d: Status 404 returned error can't find the container with id 41a99c70a6216a69223426520a6b338f31c558208f516b6eeef2fb03fe529f5d
Jul 20 22:57:46.754122 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:46.754105    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:57:47.560736 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:47.560684    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs" event={"ID":"b6ad572c-7a3d-44d0-a1d0-65945a6fd875","Type":"ContainerStarted","Data":"0ccbe16ed1fac6eaccf975a39b4cb2489d6ea34268cda6a0d06c6d468f462145"}
Jul 20 22:57:47.561209 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:47.560753    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs" event={"ID":"b6ad572c-7a3d-44d0-a1d0-65945a6fd875","Type":"ContainerStarted","Data":"41a99c70a6216a69223426520a6b338f31c558208f516b6eeef2fb03fe529f5d"}
Jul 20 22:57:47.561209 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:47.560779    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:47.585305 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:47.585252    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs" podStartSLOduration=2.25427076 podStartE2EDuration="2.585232291s" totalImagesPullingTime="330.961531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:57:47.58393512 +0000 UTC m=+2088.975190311" watchObservedRunningTime="2026-07-20 22:57:47.585232291 +0000 UTC m=+2088.976487484"
Jul 20 22:57:49.981911 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:49.981876    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:50.312562 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:50.312523    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:50.632536 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:50.632448    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:50.763064 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:50.763025    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:53.153606 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.153576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:53.240173 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.240143    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"]
Jul 20 22:57:53.240339 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.240288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:53.243858 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.243837    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.246189 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.246170    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-32e2ed-serving-cert\""
Jul 20 22:57:53.252867 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.252831    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"]
Jul 20 22:57:53.314843 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.314808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:53.317993 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.317973    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7x85\" (UniqueName: \"kubernetes.io/projected/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-kube-api-access-f7x85\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.318109 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.318002    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-maas-api-tls\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.318109 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.318025    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.412061 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.411965    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:53.419119 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.419096    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7x85\" (UniqueName: \"kubernetes.io/projected/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-kube-api-access-f7x85\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.419194 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.419129    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-maas-api-tls\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.419194 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.419152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.419922 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.419903    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.421516 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.421499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-maas-api-tls\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.427817 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.427791    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7x85\" (UniqueName: \"kubernetes.io/projected/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-kube-api-access-f7x85\") pod \"maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.554915 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.554880    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:53.579863 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.579053    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:57:53.728549 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.728528    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"]
Jul 20 22:57:53.730875 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:57:53.730846    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a9d2e8_a9d2_4d8e_84e8_442119cc7cae.slice/crio-e6f193249151b264e7394dcc9934ec3d2f0001aa916ef615c5150c008d1ec464 WatchSource:0}: Error finding container e6f193249151b264e7394dcc9934ec3d2f0001aa916ef615c5150c008d1ec464: Status 404 returned error can't find the container with id e6f193249151b264e7394dcc9934ec3d2f0001aa916ef615c5150c008d1ec464
Jul 20 22:57:53.825805 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.825771    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:53.925366 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:53.925332    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:54.597243 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:54.597201    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd" event={"ID":"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae","Type":"ContainerStarted","Data":"d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6"}
Jul 20 22:57:54.597613 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:54.597256    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd" event={"ID":"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae","Type":"ContainerStarted","Data":"e6f193249151b264e7394dcc9934ec3d2f0001aa916ef615c5150c008d1ec464"}
Jul 20 22:57:54.597613 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:54.597314    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:57:54.616330 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:54.616280    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd" podStartSLOduration=1.295230221 podStartE2EDuration="1.616265948s" totalImagesPullingTime="321.035727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:57:54.613982219 +0000 UTC m=+2096.005237413" watchObservedRunningTime="2026-07-20 22:57:54.616265948 +0000 UTC m=+2096.007521142"
Jul 20 22:57:57.635418 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:57.635387    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:57:58.616601 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:58.616568    2572 generic.go:356] "Generic (PLEG): container finished" podID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerID="bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b" exitCode=0
Jul 20 22:57:58.616820 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:58.616643    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" event={"ID":"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a","Type":"ContainerDied","Data":"bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b"}
Jul 20 22:57:58.617104 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:58.617089    2572 scope.go:117] "RemoveContainer" containerID="bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b"
Jul 20 22:57:58.618090 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:58.618063    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:57:58.618179 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:58.618143    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:57:58.618239 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:58.618188    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 22:57:59.253018 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:59.252991    2572 scope.go:117] "RemoveContainer" containerID="dd3233e7b59e9b901126643ad817ead2adf3cc202b2839978f57e23159be0cc3"
Jul 20 22:57:59.621976 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:59.621941    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" event={"ID":"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a","Type":"ContainerStarted","Data":"c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619"}
Jul 20 22:57:59.867711 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:59.867657    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:57:59.868829 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:59.868801    2572 patch_prober.go:28] interesting pod/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 20 22:57:59.868949 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:57:59.868860    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 20 22:58:00.551426 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:00.551390    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:58:00.607509 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:00.607484    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 22:58:00.867869 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:00.867776    2572 patch_prober.go:28] interesting pod/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 20 22:58:00.868187 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:00.868153    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 20 22:58:01.867599 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:01.867108    2572 patch_prober.go:28] interesting pod/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 20 22:58:01.867599 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:01.867213    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 20 22:58:02.867965 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:02.867910    2572 patch_prober.go:28] interesting pod/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 20 22:58:02.868533 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:02.868496    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 20 22:58:03.871744 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:03.871688    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:58:03.873061 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:03.873043    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 22:58:07.113166 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:07.113138    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:58:07.213372 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:07.213341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:58:14.853123 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:14.853088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:58:14.953745 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:14.953688    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:58:18.398311 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.398278    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"]
Jul 20 22:58:18.401501 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.401484    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.403829 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.403809    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a2ebf0\"/\"kube-root-ca.crt\""
Jul 20 22:58:18.404741 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.404723    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a2ebf0\"/\"openshift-service-ca.crt\""
Jul 20 22:58:18.404859 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.404740    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a2ebf0\"/\"test-model-a2ebf0-kserve-self-signed-certs\""
Jul 20 22:58:18.405115 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.405099    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a2ebf0\"/\"default-dockercfg-nkk5n\""
Jul 20 22:58:18.410964 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.410941    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"]
Jul 20 22:58:18.421154 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.421125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:58:18.544334 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.544305    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-dshm\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.544506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.544345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9825a8-070d-4444-b00a-70b2d4002fc6-tls-certs\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.544506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.544379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-home\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.544506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.544423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv6cg\" (UniqueName: \"kubernetes.io/projected/4f9825a8-070d-4444-b00a-70b2d4002fc6-kube-api-access-cv6cg\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.544506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.544455    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-model-cache\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.544506 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.544481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-tmp-dir\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645430 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645399    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-home\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645430 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645438    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv6cg\" (UniqueName: \"kubernetes.io/projected/4f9825a8-070d-4444-b00a-70b2d4002fc6-kube-api-access-cv6cg\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645662 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645477    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-model-cache\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645662 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645499    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-tmp-dir\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645662 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645532    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-dshm\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645662 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9825a8-070d-4444-b00a-70b2d4002fc6-tls-certs\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645938 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-home\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645938 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645893    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-model-cache\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.645938 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.645923    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-tmp-dir\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.647820 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.647791    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-dshm\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.648018 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.648003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9825a8-070d-4444-b00a-70b2d4002fc6-tls-certs\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.653467 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.653418    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv6cg\" (UniqueName: \"kubernetes.io/projected/4f9825a8-070d-4444-b00a-70b2d4002fc6-kube-api-access-cv6cg\") pod \"test-model-a2ebf0-kserve-8b95f4b97-h24bn\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") " pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.711406 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.711380    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:18.839032 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:18.839002    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"]
Jul 20 22:58:18.842269 ip-10-0-136-15 kubenswrapper[2572]: W0720 22:58:18.842234    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f9825a8_070d_4444_b00a_70b2d4002fc6.slice/crio-7c4d992b00f4910e5a5e7cf141dcd0e66cbe9fe852dc17574af51572ce5acab9 WatchSource:0}: Error finding container 7c4d992b00f4910e5a5e7cf141dcd0e66cbe9fe852dc17574af51572ce5acab9: Status 404 returned error can't find the container with id 7c4d992b00f4910e5a5e7cf141dcd0e66cbe9fe852dc17574af51572ce5acab9
Jul 20 22:58:19.708229 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:19.708195    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn" event={"ID":"4f9825a8-070d-4444-b00a-70b2d4002fc6","Type":"ContainerStarted","Data":"1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79"}
Jul 20 22:58:19.708615 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:19.708242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn" event={"ID":"4f9825a8-070d-4444-b00a-70b2d4002fc6","Type":"ContainerStarted","Data":"7c4d992b00f4910e5a5e7cf141dcd0e66cbe9fe852dc17574af51572ce5acab9"}
Jul 20 22:58:19.725903 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:19.725855    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn" podStartSLOduration=1.725839677 podStartE2EDuration="1.725839677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:58:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:58:19.724323485 +0000 UTC m=+2121.115578678" watchObservedRunningTime="2026-07-20 22:58:19.725839677 +0000 UTC m=+2121.117094873"
Jul 20 22:58:28.712281 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:28.712241    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:28.712718 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:28.712293    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:28.725725 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:28.725674    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:28.756583 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:28.756545    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:58:34.060902 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:34.060864    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:58:34.161496 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:34.161430    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:58:41.624508 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:58:41.624465    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:33.101906 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:33.101870    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"]
Jul 20 22:59:33.122791 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:33.122760    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:33.999664 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:33.999634    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:34.683300 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:34.683257    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:34.783051 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:34.783011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:37.438567 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:37.438515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:44.743641 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:44.743604    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"]
Jul 20 22:59:44.744174 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:44.743902    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs" podUID="b6ad572c-7a3d-44d0-a1d0-65945a6fd875" containerName="maas-api" containerID="cri-o://0ccbe16ed1fac6eaccf975a39b4cb2489d6ea34268cda6a0d06c6d468f462145" gracePeriod=30
Jul 20 22:59:44.774345 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:44.774305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:45.061525 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.061491    2572 generic.go:356] "Generic (PLEG): container finished" podID="b6ad572c-7a3d-44d0-a1d0-65945a6fd875" containerID="0ccbe16ed1fac6eaccf975a39b4cb2489d6ea34268cda6a0d06c6d468f462145" exitCode=0
Jul 20 22:59:45.061588 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.061558    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs" event={"ID":"b6ad572c-7a3d-44d0-a1d0-65945a6fd875","Type":"ContainerDied","Data":"0ccbe16ed1fac6eaccf975a39b4cb2489d6ea34268cda6a0d06c6d468f462145"}
Jul 20 22:59:45.190860 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.190834    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:59:45.307986 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.307950    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-openshift-service-ca\") pod \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") "
Jul 20 22:59:45.308157 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.307995    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hllf\" (UniqueName: \"kubernetes.io/projected/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-kube-api-access-2hllf\") pod \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") "
Jul 20 22:59:45.308157 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.308024    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls\") pod \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\" (UID: \"b6ad572c-7a3d-44d0-a1d0-65945a6fd875\") "
Jul 20 22:59:45.308316 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.308294    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6ad572c-7a3d-44d0-a1d0-65945a6fd875" (UID: "b6ad572c-7a3d-44d0-a1d0-65945a6fd875"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:59:45.310066 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.310039    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6ad572c-7a3d-44d0-a1d0-65945a6fd875" (UID: "b6ad572c-7a3d-44d0-a1d0-65945a6fd875"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:59:45.310192 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.310170    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-kube-api-access-2hllf" (OuterVolumeSpecName: "kube-api-access-2hllf") pod "b6ad572c-7a3d-44d0-a1d0-65945a6fd875" (UID: "b6ad572c-7a3d-44d0-a1d0-65945a6fd875"). InnerVolumeSpecName "kube-api-access-2hllf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:59:45.409648 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.409607    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:45.409648 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.409641    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hllf\" (UniqueName: \"kubernetes.io/projected/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-kube-api-access-2hllf\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:45.409648 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:45.409651    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6ad572c-7a3d-44d0-a1d0-65945a6fd875-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:46.067530 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:46.067486    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs" event={"ID":"b6ad572c-7a3d-44d0-a1d0-65945a6fd875","Type":"ContainerDied","Data":"41a99c70a6216a69223426520a6b338f31c558208f516b6eeef2fb03fe529f5d"}
Jul 20 22:59:46.067974 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:46.067566    2572 scope.go:117] "RemoveContainer" containerID="0ccbe16ed1fac6eaccf975a39b4cb2489d6ea34268cda6a0d06c6d468f462145"
Jul 20 22:59:46.067974 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:46.067500    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"
Jul 20 22:59:46.091576 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:46.091543    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"]
Jul 20 22:59:46.094927 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:46.094889    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a2ebf0-57d7cb5646-7mmhs"]
Jul 20 22:59:47.170717 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:47.170664    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6ad572c-7a3d-44d0-a1d0-65945a6fd875" path="/var/lib/kubelet/pods/b6ad572c-7a3d-44d0-a1d0-65945a6fd875/volumes"
Jul 20 22:59:48.121874 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.121824    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn" podUID="4f9825a8-070d-4444-b00a-70b2d4002fc6" containerName="main" containerID="cri-o://1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79" gracePeriod=45
Jul 20 22:59:48.385133 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.385068    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:59:48.535357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535327    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv6cg\" (UniqueName: \"kubernetes.io/projected/4f9825a8-070d-4444-b00a-70b2d4002fc6-kube-api-access-cv6cg\") pod \"4f9825a8-070d-4444-b00a-70b2d4002fc6\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") "
Jul 20 22:59:48.535357 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535364    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-model-cache\") pod \"4f9825a8-070d-4444-b00a-70b2d4002fc6\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") "
Jul 20 22:59:48.535614 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535400    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-tmp-dir\") pod \"4f9825a8-070d-4444-b00a-70b2d4002fc6\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") "
Jul 20 22:59:48.535614 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535424    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-home\") pod \"4f9825a8-070d-4444-b00a-70b2d4002fc6\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") "
Jul 20 22:59:48.535614 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535453    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9825a8-070d-4444-b00a-70b2d4002fc6-tls-certs\") pod \"4f9825a8-070d-4444-b00a-70b2d4002fc6\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") "
Jul 20 22:59:48.535614 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535486    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-dshm\") pod \"4f9825a8-070d-4444-b00a-70b2d4002fc6\" (UID: \"4f9825a8-070d-4444-b00a-70b2d4002fc6\") "
Jul 20 22:59:48.535813 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535672    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-model-cache" (OuterVolumeSpecName: "model-cache") pod "4f9825a8-070d-4444-b00a-70b2d4002fc6" (UID: "4f9825a8-070d-4444-b00a-70b2d4002fc6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:59:48.535813 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535712    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4f9825a8-070d-4444-b00a-70b2d4002fc6" (UID: "4f9825a8-070d-4444-b00a-70b2d4002fc6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:59:48.535813 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.535742    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-home" (OuterVolumeSpecName: "home") pod "4f9825a8-070d-4444-b00a-70b2d4002fc6" (UID: "4f9825a8-070d-4444-b00a-70b2d4002fc6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:59:48.537627 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.537605    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-dshm" (OuterVolumeSpecName: "dshm") pod "4f9825a8-070d-4444-b00a-70b2d4002fc6" (UID: "4f9825a8-070d-4444-b00a-70b2d4002fc6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:59:48.537704 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.537648    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f9825a8-070d-4444-b00a-70b2d4002fc6-kube-api-access-cv6cg" (OuterVolumeSpecName: "kube-api-access-cv6cg") pod "4f9825a8-070d-4444-b00a-70b2d4002fc6" (UID: "4f9825a8-070d-4444-b00a-70b2d4002fc6"). InnerVolumeSpecName "kube-api-access-cv6cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:59:48.537770 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.537752    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f9825a8-070d-4444-b00a-70b2d4002fc6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4f9825a8-070d-4444-b00a-70b2d4002fc6" (UID: "4f9825a8-070d-4444-b00a-70b2d4002fc6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:59:48.636939 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.636851    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-home\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:48.636939 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.636883    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4f9825a8-070d-4444-b00a-70b2d4002fc6-tls-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:48.636939 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.636894    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-dshm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:48.636939 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.636903    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv6cg\" (UniqueName: \"kubernetes.io/projected/4f9825a8-070d-4444-b00a-70b2d4002fc6-kube-api-access-cv6cg\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:48.636939 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.636913    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-model-cache\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:48.636939 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:48.636943    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f9825a8-070d-4444-b00a-70b2d4002fc6-tmp-dir\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 22:59:49.082259 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.082228    2572 generic.go:356] "Generic (PLEG): container finished" podID="4f9825a8-070d-4444-b00a-70b2d4002fc6" containerID="1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79" exitCode=0
Jul 20 22:59:49.082445 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.082271    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"
Jul 20 22:59:49.082445 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.082274    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn" event={"ID":"4f9825a8-070d-4444-b00a-70b2d4002fc6","Type":"ContainerDied","Data":"1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79"}
Jul 20 22:59:49.082445 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.082392    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn" event={"ID":"4f9825a8-070d-4444-b00a-70b2d4002fc6","Type":"ContainerDied","Data":"7c4d992b00f4910e5a5e7cf141dcd0e66cbe9fe852dc17574af51572ce5acab9"}
Jul 20 22:59:49.082445 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.082418    2572 scope.go:117] "RemoveContainer" containerID="1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79"
Jul 20 22:59:49.090869 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.090848    2572 scope.go:117] "RemoveContainer" containerID="1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79"
Jul 20 22:59:49.091124 ip-10-0-136-15 kubenswrapper[2572]: E0720 22:59:49.091103    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79\": container with ID starting with 1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79 not found: ID does not exist" containerID="1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79"
Jul 20 22:59:49.091171 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.091151    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79"} err="failed to get container status \"1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79\": rpc error: code = NotFound desc = could not find container \"1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79\": container with ID starting with 1df2d61f53988444fe718e248340d246065dd6c72e1e73f5d59adddc464e7c79 not found: ID does not exist"
Jul 20 22:59:49.101565 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.101542    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"]
Jul 20 22:59:49.105735 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.105710    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a2ebf0/test-model-a2ebf0-kserve-8b95f4b97-h24bn"]
Jul 20 22:59:49.169906 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.169875    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f9825a8-070d-4444-b00a-70b2d4002fc6" path="/var/lib/kubelet/pods/4f9825a8-070d-4444-b00a-70b2d4002fc6/volumes"
Jul 20 22:59:49.203268 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.203234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:49.606454 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:49.606413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:55.428710 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:55.428656    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:55.529159 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:55.529120    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:55.671116 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:55.671079    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"]
Jul 20 22:59:55.671361 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:55.671333    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy" containerID="cri-o://c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619" gracePeriod=30
Jul 20 22:59:55.694405 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:55.694329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:55.926412 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:55.926381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:56.544751 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:56.544716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 22:59:56.645340 ip-10-0-136-15 kubenswrapper[2572]: I0720 22:59:56.645304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:00.138599 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.138563    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"]
Jul 20 23:00:00.139002 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.138906    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ad572c-7a3d-44d0-a1d0-65945a6fd875" containerName="maas-api"
Jul 20 23:00:00.139002 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.138918    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ad572c-7a3d-44d0-a1d0-65945a6fd875" containerName="maas-api"
Jul 20 23:00:00.139002 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.138938    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f9825a8-070d-4444-b00a-70b2d4002fc6" containerName="main"
Jul 20 23:00:00.139002 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.138944    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f9825a8-070d-4444-b00a-70b2d4002fc6" containerName="main"
Jul 20 23:00:00.139002 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.138994    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ad572c-7a3d-44d0-a1d0-65945a6fd875" containerName="maas-api"
Jul 20 23:00:00.139002 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.139003    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f9825a8-070d-4444-b00a-70b2d4002fc6" containerName="main"
Jul 20 23:00:00.143675 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.143654    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"
Jul 20 23:00:00.146132 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.146106    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 23:00:00.153571 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.153546    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"]
Jul 20 23:00:00.153688 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.153575    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"
Jul 20 23:00:00.288972 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.288919    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"]
Jul 20 23:00:00.291440 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:00:00.291412    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e40dea1_4c10_4167_a0b2_69bde093c3ca.slice/crio-8456104146c097e0af27691707b6c0770763ae412368bd9758db9f2490c0de09 WatchSource:0}: Error finding container 8456104146c097e0af27691707b6c0770763ae412368bd9758db9f2490c0de09: Status 404 returned error can't find the container with id 8456104146c097e0af27691707b6c0770763ae412368bd9758db9f2490c0de09
Jul 20 23:00:00.910335 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:00.910313    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 23:00:01.047034 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.046943    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-data\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047034 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.046983    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-socket\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047034 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047015    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-credential-socket\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047317 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047038    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-certs\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047317 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047058    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-token\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047317 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047124    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-envoy\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047317 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047148    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istiod-ca-cert\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047317 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047180    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-podinfo\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047551 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047321    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:00:01.047551 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047358    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:00:01.047660 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047596    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:00:01.047736 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047677    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:00:01.047736 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047267    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjrr7\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-kube-api-access-hjrr7\") pod \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\" (UID: \"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a\") "
Jul 20 23:00:01.047969 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.047944    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-data" (OuterVolumeSpecName: "istio-data") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:00:01.048087 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.048072    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istiod-ca-cert\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.048133 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.048091    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-data\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.048133 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.048104    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.048133 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.048117    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-credential-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.048133 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.048131    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-workload-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.049524 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.049495    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:00:01.049622 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.049519    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-kube-api-access-hjrr7" (OuterVolumeSpecName: "kube-api-access-hjrr7") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "kube-api-access-hjrr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:00:01.049780 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.049755    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 23:00:01.049848 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.049775    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" (UID: "7efac2bd-96c2-4d7f-8719-5310ef6b5b6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:00:01.133505 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.133468    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d" event={"ID":"9e40dea1-4c10-4167-a0b2-69bde093c3ca","Type":"ContainerStarted","Data":"518cb6f4b02fb7b5c516e7a5f610e8cabe299d4ff17440f67b72b0fa86ffa6e2"}
Jul 20 23:00:01.133719 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.133529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d" event={"ID":"9e40dea1-4c10-4167-a0b2-69bde093c3ca","Type":"ContainerStarted","Data":"8456104146c097e0af27691707b6c0770763ae412368bd9758db9f2490c0de09"}
Jul 20 23:00:01.134997 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.134972    2572 generic.go:356] "Generic (PLEG): container finished" podID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerID="c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619" exitCode=0
Jul 20 23:00:01.135097 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.135004    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" event={"ID":"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a","Type":"ContainerDied","Data":"c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619"}
Jul 20 23:00:01.135097 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.135017    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"
Jul 20 23:00:01.135097 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.135033    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58" event={"ID":"7efac2bd-96c2-4d7f-8719-5310ef6b5b6a","Type":"ContainerDied","Data":"06a17231e6057c291a7768a5c9fb35f393ea34eee891f3490f32211c5ee2bbc7"}
Jul 20 23:00:01.135097 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.135055    2572 scope.go:117] "RemoveContainer" containerID="c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619"
Jul 20 23:00:01.143586 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.143568    2572 scope.go:117] "RemoveContainer" containerID="bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b"
Jul 20 23:00:01.148981 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.148959    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-token\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.148981 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.148982    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-envoy\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.149101 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.148991    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-istio-podinfo\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.149101 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.149000    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjrr7\" (UniqueName: \"kubernetes.io/projected/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a-kube-api-access-hjrr7\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:01.149951 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.149904    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d" podStartSLOduration=1.149886767 podStartE2EDuration="1.149886767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:00:01.147401861 +0000 UTC m=+2222.538657056" watchObservedRunningTime="2026-07-20 23:00:01.149886767 +0000 UTC m=+2222.541141968"
Jul 20 23:00:01.151872 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.151852    2572 scope.go:117] "RemoveContainer" containerID="c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619"
Jul 20 23:00:01.152144 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:00:01.152126    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619\": container with ID starting with c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619 not found: ID does not exist" containerID="c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619"
Jul 20 23:00:01.152187 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.152152    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619"} err="failed to get container status \"c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619\": rpc error: code = NotFound desc = could not find container \"c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619\": container with ID starting with c6d52faafcf1038f5eb00badad0050889e3eec69f1b88850527b78987f700619 not found: ID does not exist"
Jul 20 23:00:01.152187 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.152169    2572 scope.go:117] "RemoveContainer" containerID="bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b"
Jul 20 23:00:01.152379 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:00:01.152363    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b\": container with ID starting with bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b not found: ID does not exist" containerID="bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b"
Jul 20 23:00:01.152423 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.152383    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b"} err="failed to get container status \"bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b\": rpc error: code = NotFound desc = could not find container \"bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b\": container with ID starting with bc56bd89bd87eb1fee529a88f82de9b8387c9dec2c8a4455aa802d9446fcda4b not found: ID does not exist"
Jul 20 23:00:01.160030 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.160008    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"]
Jul 20 23:00:01.170923 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:01.170900    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a2ebf0-openshift-default-6d9b5569df-m4x58"]
Jul 20 23:00:02.141767 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:02.141730    2572 generic.go:356] "Generic (PLEG): container finished" podID="9e40dea1-4c10-4167-a0b2-69bde093c3ca" containerID="518cb6f4b02fb7b5c516e7a5f610e8cabe299d4ff17440f67b72b0fa86ffa6e2" exitCode=0
Jul 20 23:00:02.141957 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:02.141800    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d" event={"ID":"9e40dea1-4c10-4167-a0b2-69bde093c3ca","Type":"ContainerDied","Data":"518cb6f4b02fb7b5c516e7a5f610e8cabe299d4ff17440f67b72b0fa86ffa6e2"}
Jul 20 23:00:03.170319 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:03.170281    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" path="/var/lib/kubelet/pods/7efac2bd-96c2-4d7f-8719-5310ef6b5b6a/volumes"
Jul 20 23:00:03.286327 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:03.286297    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"
Jul 20 23:00:04.151787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:04.151752    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d" event={"ID":"9e40dea1-4c10-4167-a0b2-69bde093c3ca","Type":"ContainerDied","Data":"8456104146c097e0af27691707b6c0770763ae412368bd9758db9f2490c0de09"}
Jul 20 23:00:04.152102 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:04.151796    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"
Jul 20 23:00:04.152102 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:04.151827    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8456104146c097e0af27691707b6c0770763ae412368bd9758db9f2490c0de09"
Jul 20 23:00:06.439722 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.439672    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"]
Jul 20 23:00:06.440241 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.439942    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd" podUID="73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" containerName="maas-api" containerID="cri-o://d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6" gracePeriod=30
Jul 20 23:00:06.462058 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.462012    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:06.466789 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.466765    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"]
Jul 20 23:00:06.469501 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.469478    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-32e2ed-29743140-bww2d"]
Jul 20 23:00:06.686481 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.686456    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 23:00:06.800599 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.800491    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-maas-api-tls\") pod \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") "
Jul 20 23:00:06.800599 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.800559    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-openshift-service-ca\") pod \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") "
Jul 20 23:00:06.800599 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.800605    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7x85\" (UniqueName: \"kubernetes.io/projected/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-kube-api-access-f7x85\") pod \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\" (UID: \"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae\") "
Jul 20 23:00:06.801054 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.801025    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" (UID: "73a9d2e8-a9d2-4d8e-84e8-442119cc7cae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:00:06.802763 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.802734    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" (UID: "73a9d2e8-a9d2-4d8e-84e8-442119cc7cae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:00:06.802889 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.802862    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-kube-api-access-f7x85" (OuterVolumeSpecName: "kube-api-access-f7x85") pod "73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" (UID: "73a9d2e8-a9d2-4d8e-84e8-442119cc7cae"). InnerVolumeSpecName "kube-api-access-f7x85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:00:06.901626 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.901579    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:06.901626 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.901617    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7x85\" (UniqueName: \"kubernetes.io/projected/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-kube-api-access-f7x85\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:06.901626 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:06.901631    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:07.167464 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.167428    2572 generic.go:356] "Generic (PLEG): container finished" podID="73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" containerID="d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6" exitCode=0
Jul 20 23:00:07.167640 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.167539    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"
Jul 20 23:00:07.169298 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.169271    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e40dea1-4c10-4167-a0b2-69bde093c3ca" path="/var/lib/kubelet/pods/9e40dea1-4c10-4167-a0b2-69bde093c3ca/volumes"
Jul 20 23:00:07.169673 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.169653    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd" event={"ID":"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae","Type":"ContainerDied","Data":"d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6"}
Jul 20 23:00:07.169795 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.169723    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd" event={"ID":"73a9d2e8-a9d2-4d8e-84e8-442119cc7cae","Type":"ContainerDied","Data":"e6f193249151b264e7394dcc9934ec3d2f0001aa916ef615c5150c008d1ec464"}
Jul 20 23:00:07.169795 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.169758    2572 scope.go:117] "RemoveContainer" containerID="d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6"
Jul 20 23:00:07.179381 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.179358    2572 scope.go:117] "RemoveContainer" containerID="d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6"
Jul 20 23:00:07.179668 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:00:07.179649    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6\": container with ID starting with d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6 not found: ID does not exist" containerID="d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6"
Jul 20 23:00:07.179749 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.179678    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6"} err="failed to get container status \"d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6\": rpc error: code = NotFound desc = could not find container \"d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6\": container with ID starting with d18e6e3b1251a07ff6f6baf38b4cef7170849bafa7f07919df2c4520bd14a7d6 not found: ID does not exist"
Jul 20 23:00:07.191117 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.191082    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"]
Jul 20 23:00:07.195045 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:07.195019    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32e2ed-78f477c88d-wwxxd"]
Jul 20 23:00:09.169387 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:09.169351    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" path="/var/lib/kubelet/pods/73a9d2e8-a9d2-4d8e-84e8-442119cc7cae/volumes"
Jul 20 23:00:11.113053 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:11.113014    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:11.501114 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:11.501022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:17.912738 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:17.912679    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:18.013276 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:18.013222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:18.277581 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:18.277489    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:18.447264 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:18.447228    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:18.803988 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:18.803955    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:19.088202 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088111    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"]
Jul 20 23:00:19.088631 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088517    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e40dea1-4c10-4167-a0b2-69bde093c3ca" containerName="cleanup"
Jul 20 23:00:19.088631 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088534    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e40dea1-4c10-4167-a0b2-69bde093c3ca" containerName="cleanup"
Jul 20 23:00:19.088631 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088549    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy"
Jul 20 23:00:19.088631 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088559    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy"
Jul 20 23:00:19.088631 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088582    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" containerName="maas-api"
Jul 20 23:00:19.088631 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088590    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" containerName="maas-api"
Jul 20 23:00:19.088960 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088668    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy"
Jul 20 23:00:19.088960 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088683    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="73a9d2e8-a9d2-4d8e-84e8-442119cc7cae" containerName="maas-api"
Jul 20 23:00:19.088960 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.088711    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e40dea1-4c10-4167-a0b2-69bde093c3ca" containerName="cleanup"
Jul 20 23:00:19.092950 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.092926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.095476 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.095455    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-402b6b-openshift-default-dockercfg-6hd85\""
Jul 20 23:00:19.095590 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.095480    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 23:00:19.105057 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.105028    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"]
Jul 20 23:00:19.124326 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.124289    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:19.208818 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.208783    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-certs\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.209001 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.208826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-envoy\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.209001 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.208891    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-istio-token\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.209001 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.208924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81e357bd-9a25-4cae-af6c-431db34282d3-istio-podinfo\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.209001 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.208956    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-data\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.209001 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.208978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-credential-socket\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.209001 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.208999    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-socket\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.209211 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.209070    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81e357bd-9a25-4cae-af6c-431db34282d3-istiod-ca-cert\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.209211 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.209117    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjgq5\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-kube-api-access-sjgq5\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.309997 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.309958    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-certs\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310188 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310005    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-envoy\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310188 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-istio-token\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310188 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310079    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81e357bd-9a25-4cae-af6c-431db34282d3-istio-podinfo\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310188 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310111    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-data\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310188 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310145    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-credential-socket\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310188 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310173    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-socket\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310511 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81e357bd-9a25-4cae-af6c-431db34282d3-istiod-ca-cert\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310511 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310268    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgq5\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-kube-api-access-sjgq5\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310511 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310443    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-certs\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310666 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310540    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-credential-socket\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310666 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310605    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-data\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310666 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-socket\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.310972 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.310954    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81e357bd-9a25-4cae-af6c-431db34282d3-istiod-ca-cert\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.312544 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.312521    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-envoy\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.312676 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.312661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81e357bd-9a25-4cae-af6c-431db34282d3-istio-podinfo\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.318201 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.318180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-istio-token\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.318311 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.318261    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjgq5\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-kube-api-access-sjgq5\") pod \"e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") " pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.402591 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.402490    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:19.538750 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.538723    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"]
Jul 20 23:00:19.541142 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:00:19.541113    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e357bd_9a25_4cae_af6c_431db34282d3.slice/crio-a9d268d0963da6baf66fce73ad9e2f971e9decd9567ea67c9dec0c60f8c56c73 WatchSource:0}: Error finding container a9d268d0963da6baf66fce73ad9e2f971e9decd9567ea67c9dec0c60f8c56c73: Status 404 returned error can't find the container with id a9d268d0963da6baf66fce73ad9e2f971e9decd9567ea67c9dec0c60f8c56c73
Jul 20 23:00:19.543219 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.543186    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:00:19.543282 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.543252    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:00:19.543326 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:19.543300    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:00:20.223213 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:20.223180    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" event={"ID":"81e357bd-9a25-4cae-af6c-431db34282d3","Type":"ContainerStarted","Data":"3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba"}
Jul 20 23:00:20.223595 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:20.223241    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" event={"ID":"81e357bd-9a25-4cae-af6c-431db34282d3","Type":"ContainerStarted","Data":"a9d268d0963da6baf66fce73ad9e2f971e9decd9567ea67c9dec0c60f8c56c73"}
Jul 20 23:00:20.244347 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:20.244291    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podStartSLOduration=1.244274316 podStartE2EDuration="1.244274316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:00:20.242726232 +0000 UTC m=+2241.633981429" watchObservedRunningTime="2026-07-20 23:00:20.244274316 +0000 UTC m=+2241.635529511"
Jul 20 23:00:20.402864 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:20.402828    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:20.408079 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:20.408049    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:20.777777 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:20.777679    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:21.227141 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:21.227110    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:21.228112 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:21.228091    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:22.144058 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.144018    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:22.227224 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.227192    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"]
Jul 20 23:00:22.227662 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.227598    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy"
Jul 20 23:00:22.227662 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.227616    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy"
Jul 20 23:00:22.227784 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.227720    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7efac2bd-96c2-4d7f-8719-5310ef6b5b6a" containerName="istio-proxy"
Jul 20 23:00:22.228985 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.228946    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:22.230945 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.230922    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.233381 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.233353    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 23:00:22.233517 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.233401    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 23:00:22.233517 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.233413    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-402b6b-serving-cert\""
Jul 20 23:00:22.234079 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.234059    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 23:00:22.240808 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.240778    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"]
Jul 20 23:00:22.294450 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.294410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:22.334373 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.334332    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-openshift-service-ca\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.334567 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.334392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcxjw\" (UniqueName: \"kubernetes.io/projected/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-kube-api-access-gcxjw\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.334639 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.334567    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.436126 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.436021    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.436126 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.436096    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-openshift-service-ca\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.436126 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.436125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcxjw\" (UniqueName: \"kubernetes.io/projected/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-kube-api-access-gcxjw\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.436421 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:00:22.436197    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-serving-cert: secret "maas-api-e2e-api-a-402b6b-serving-cert" not found
Jul 20 23:00:22.436421 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:00:22.436278    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls podName:a8677813-4ee3-4eb9-86f6-773f38fa6ea0 nodeName:}" failed. No retries permitted until 2026-07-20 23:00:22.936255747 +0000 UTC m=+2244.327510925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls") pod "maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d" (UID: "a8677813-4ee3-4eb9-86f6-773f38fa6ea0") : secret "maas-api-e2e-api-a-402b6b-serving-cert" not found
Jul 20 23:00:22.436886 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.436868    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-openshift-service-ca\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.446311 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.446292    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcxjw\" (UniqueName: \"kubernetes.io/projected/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-kube-api-access-gcxjw\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.578502 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.578464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:22.854827 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.854789    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:22.941274 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.941230    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.943673 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.943653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls\") pod \"maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:22.957634 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:22.957599    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:23.143633 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:23.143531    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:23.274881 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:23.274841    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"]
Jul 20 23:00:23.278442 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:00:23.278415    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8677813_4ee3_4eb9_86f6_773f38fa6ea0.slice/crio-b61bcbc3a54d4837835690c2e3d56af0e17ff6f5e169f6b885b5175929310dad WatchSource:0}: Error finding container b61bcbc3a54d4837835690c2e3d56af0e17ff6f5e169f6b885b5175929310dad: Status 404 returned error can't find the container with id b61bcbc3a54d4837835690c2e3d56af0e17ff6f5e169f6b885b5175929310dad
Jul 20 23:00:24.242195 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:24.242161    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d" event={"ID":"a8677813-4ee3-4eb9-86f6-773f38fa6ea0","Type":"ContainerStarted","Data":"c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2"}
Jul 20 23:00:24.242374 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:24.242213    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d" event={"ID":"a8677813-4ee3-4eb9-86f6-773f38fa6ea0","Type":"ContainerStarted","Data":"b61bcbc3a54d4837835690c2e3d56af0e17ff6f5e169f6b885b5175929310dad"}
Jul 20 23:00:24.242374 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:24.242294    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:24.258388 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:24.258338    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d" podStartSLOduration=1.757406525 podStartE2EDuration="2.258323137s" totalImagesPullingTime="500.916612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:00:24.258099647 +0000 UTC m=+2245.649354855" watchObservedRunningTime="2026-07-20 23:00:24.258323137 +0000 UTC m=+2245.649578324"
Jul 20 23:00:26.650815 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:26.650760    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:27.112363 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:27.112321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:27.426220 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:27.426132    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:27.724917 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:27.724825    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:30.166165 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.166109    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:30.251718 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.251674    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:30.266490 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.266423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:30.295281 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.295244    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"]
Jul 20 23:00:30.298523 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.298498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.306720 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.306683    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-d1c09f-serving-cert\""
Jul 20 23:00:30.333731 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.333682    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"]
Jul 20 23:00:30.410063 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.410019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50128200-61cc-4cd5-9ddc-251dab9387f7-openshift-service-ca\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.410285 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.410078    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9zxf\" (UniqueName: \"kubernetes.io/projected/50128200-61cc-4cd5-9ddc-251dab9387f7-kube-api-access-j9zxf\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.410285 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.410162    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.417544 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.417456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:30.511018 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.510976    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.511203 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.511049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50128200-61cc-4cd5-9ddc-251dab9387f7-openshift-service-ca\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.511203 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.511077    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9zxf\" (UniqueName: \"kubernetes.io/projected/50128200-61cc-4cd5-9ddc-251dab9387f7-kube-api-access-j9zxf\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.511203 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:00:30.511154    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-serving-cert: secret "maas-api-e2e-api-b-d1c09f-serving-cert" not found
Jul 20 23:00:30.511395 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:00:30.511239    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls podName:50128200-61cc-4cd5-9ddc-251dab9387f7 nodeName:}" failed. No retries permitted until 2026-07-20 23:00:31.011216021 +0000 UTC m=+2252.402471209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls") pod "maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6" (UID: "50128200-61cc-4cd5-9ddc-251dab9387f7") : secret "maas-api-e2e-api-b-d1c09f-serving-cert" not found
Jul 20 23:00:30.511770 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.511750    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50128200-61cc-4cd5-9ddc-251dab9387f7-openshift-service-ca\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.523476 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.523443    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9zxf\" (UniqueName: \"kubernetes.io/projected/50128200-61cc-4cd5-9ddc-251dab9387f7-kube-api-access-j9zxf\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:30.623403 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.623357    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:30.928981 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:30.928944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:31.015320 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:31.015281    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:31.017740 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:31.017713    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls\") pod \"maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:31.029451 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:31.029419    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:31.209869 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:31.209769    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:31.372596 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:31.372509    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"]
Jul 20 23:00:32.288724 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:32.287847    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6" event={"ID":"50128200-61cc-4cd5-9ddc-251dab9387f7","Type":"ContainerStarted","Data":"1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425"}
Jul 20 23:00:32.288724 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:32.287922    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6" event={"ID":"50128200-61cc-4cd5-9ddc-251dab9387f7","Type":"ContainerStarted","Data":"d2a07e0c0da2d0e25bdc73b64ca369099f65dce9ba2d573e33193e1f4fdd301a"}
Jul 20 23:00:32.288724 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:32.288653    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:32.305022 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:32.304960    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6" podStartSLOduration=2.007709737 podStartE2EDuration="2.304944404s" totalImagesPullingTime="297.234667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:00:32.30425407 +0000 UTC m=+2253.695509294" watchObservedRunningTime="2026-07-20 23:00:32.304944404 +0000 UTC m=+2253.696199600"
Jul 20 23:00:34.558858 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:34.558806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:37.269907 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:37.269858    2572 patch_prober.go:28] interesting pod/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 23:00:37.271075 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:37.269937    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 23:00:38.315826 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:38.315789    2572 generic.go:356] "Generic (PLEG): container finished" podID="81e357bd-9a25-4cae-af6c-431db34282d3" containerID="3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba" exitCode=0
Jul 20 23:00:38.316319 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:38.315866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" event={"ID":"81e357bd-9a25-4cae-af6c-431db34282d3","Type":"ContainerDied","Data":"3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba"}
Jul 20 23:00:38.316392 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:38.316348    2572 scope.go:117] "RemoveContainer" containerID="3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba"
Jul 20 23:00:38.317332 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:38.317305    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:00:38.317389 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:38.317376    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:00:38.317427 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:38.317415    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:00:39.303399 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:39.303369    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:00:39.328344 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:39.328301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" event={"ID":"81e357bd-9a25-4cae-af6c-431db34282d3","Type":"ContainerStarted","Data":"9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9"}
Jul 20 23:00:39.403330 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:39.403293    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:39.403564 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:39.403535    2572 patch_prober.go:28] interesting pod/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 20 23:00:39.403640 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:39.403595    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 20 23:00:40.403828 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:40.403788    2572 patch_prober.go:28] interesting pod/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 20 23:00:40.404324 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:40.403858    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 20 23:00:41.403335 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:41.403298    2572 patch_prober.go:28] interesting pod/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 20 23:00:41.403527 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:41.403355    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 20 23:00:42.403870 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:42.403828    2572 patch_prober.go:28] interesting pod/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 20 23:00:42.404284 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:42.403891    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 20 23:00:43.228152 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:43.228105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:43.293245 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:43.293209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:43.403093 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:43.403056    2572 patch_prober.go:28] interesting pod/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Jul 20 23:00:43.403237 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:43.403119    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Jul 20 23:00:44.406850 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:44.406818    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:44.407234 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:44.407076    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:44.407926 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:44.407901    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:00:51.673198 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:51.673161    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:51.779739 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:51.779682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:53.224556 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:53.224507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:53.327379 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:53.327346    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:58.485444 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.485413    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"]
Jul 20 23:00:58.485821 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.485615    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d" podUID="a8677813-4ee3-4eb9-86f6-773f38fa6ea0" containerName="maas-api" containerID="cri-o://c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2" gracePeriod=30
Jul 20 23:00:58.509809 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.509781    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:00:58.723512 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.723486    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:58.752986 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.752921    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcxjw\" (UniqueName: \"kubernetes.io/projected/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-kube-api-access-gcxjw\") pod \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") "
Jul 20 23:00:58.752986 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.752974    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls\") pod \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") "
Jul 20 23:00:58.753140 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.753048    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-openshift-service-ca\") pod \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\" (UID: \"a8677813-4ee3-4eb9-86f6-773f38fa6ea0\") "
Jul 20 23:00:58.753475 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.753441    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a8677813-4ee3-4eb9-86f6-773f38fa6ea0" (UID: "a8677813-4ee3-4eb9-86f6-773f38fa6ea0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:00:58.755080 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.755054    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-kube-api-access-gcxjw" (OuterVolumeSpecName: "kube-api-access-gcxjw") pod "a8677813-4ee3-4eb9-86f6-773f38fa6ea0" (UID: "a8677813-4ee3-4eb9-86f6-773f38fa6ea0"). InnerVolumeSpecName "kube-api-access-gcxjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:00:58.755189 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.755056    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a8677813-4ee3-4eb9-86f6-773f38fa6ea0" (UID: "a8677813-4ee3-4eb9-86f6-773f38fa6ea0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:00:58.854116 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.854078    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:58.854116 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.854112    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:58.854116 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:58.854121    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcxjw\" (UniqueName: \"kubernetes.io/projected/a8677813-4ee3-4eb9-86f6-773f38fa6ea0-kube-api-access-gcxjw\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:00:59.423638 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.423604    2572 generic.go:356] "Generic (PLEG): container finished" podID="a8677813-4ee3-4eb9-86f6-773f38fa6ea0" containerID="c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2" exitCode=0
Jul 20 23:00:59.423818 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.423647    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"
Jul 20 23:00:59.423818 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.423678    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d" event={"ID":"a8677813-4ee3-4eb9-86f6-773f38fa6ea0","Type":"ContainerDied","Data":"c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2"}
Jul 20 23:00:59.423818 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.423741    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d" event={"ID":"a8677813-4ee3-4eb9-86f6-773f38fa6ea0","Type":"ContainerDied","Data":"b61bcbc3a54d4837835690c2e3d56af0e17ff6f5e169f6b885b5175929310dad"}
Jul 20 23:00:59.423818 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.423763    2572 scope.go:117] "RemoveContainer" containerID="c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2"
Jul 20 23:00:59.431626 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.431607    2572 scope.go:117] "RemoveContainer" containerID="c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2"
Jul 20 23:00:59.431919 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:00:59.431893    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2\": container with ID starting with c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2 not found: ID does not exist" containerID="c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2"
Jul 20 23:00:59.431978 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.431927    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2"} err="failed to get container status \"c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2\": rpc error: code = NotFound desc = could not find container \"c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2\": container with ID starting with c712affb2e8fda27a188e8b6b0a85b7ae302561d43f81cf2b7eb5e462eb9d9f2 not found: ID does not exist"
Jul 20 23:00:59.439507 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.439487    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"]
Jul 20 23:00:59.445242 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:00:59.445222    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-402b6b-65c7b8fb57-lq25d"]
Jul 20 23:01:01.168873 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:01.168844    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8677813-4ee3-4eb9-86f6-773f38fa6ea0" path="/var/lib/kubelet/pods/a8677813-4ee3-4eb9-86f6-773f38fa6ea0/volumes"
Jul 20 23:01:02.659022 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:02.658980    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:03.097652 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:03.097607    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:08.923411 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:08.923372    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:09.035137 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:09.035101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:09.170017 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:09.169981    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"]
Jul 20 23:01:09.170244 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:09.170221    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy" containerID="cri-o://9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9" gracePeriod=30
Jul 20 23:01:09.187291 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:09.187205    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:09.410270 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:09.410226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:10.067723 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:10.067668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:10.165322 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:10.165288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:14.436043 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.435979    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:01:14.491056 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491026    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-certs\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491215 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491060    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-data\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491215 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491138    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81e357bd-9a25-4cae-af6c-431db34282d3-istio-podinfo\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491215 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491164    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81e357bd-9a25-4cae-af6c-431db34282d3-istiod-ca-cert\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491215 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491184    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-socket\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491215 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491199    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-credential-socket\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491438 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491239    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-istio-token\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491438 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491260    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-envoy\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491438 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491290    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjgq5\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-kube-api-access-sjgq5\") pod \"81e357bd-9a25-4cae-af6c-431db34282d3\" (UID: \"81e357bd-9a25-4cae-af6c-431db34282d3\") "
Jul 20 23:01:14.491438 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491330    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:14.491650 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491481    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:14.491650 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491546    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.491650 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491585    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-workload-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.491858 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491659    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:14.491858 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.491773    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81e357bd-9a25-4cae-af6c-431db34282d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:01:14.492284 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.492242    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:14.492672 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.492641    2572 generic.go:356] "Generic (PLEG): container finished" podID="81e357bd-9a25-4cae-af6c-431db34282d3" containerID="9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9" exitCode=0
Jul 20 23:01:14.492801 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.492744    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"
Jul 20 23:01:14.492870 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.492799    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" event={"ID":"81e357bd-9a25-4cae-af6c-431db34282d3","Type":"ContainerDied","Data":"9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9"}
Jul 20 23:01:14.492927 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.492880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" event={"ID":"81e357bd-9a25-4cae-af6c-431db34282d3","Type":"ContainerDied","Data":"a9d268d0963da6baf66fce73ad9e2f971e9decd9567ea67c9dec0c60f8c56c73"}
Jul 20 23:01:14.492927 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.492912    2572 scope.go:117] "RemoveContainer" containerID="9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9"
Jul 20 23:01:14.493917 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.493880    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-kube-api-access-sjgq5" (OuterVolumeSpecName: "kube-api-access-sjgq5") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "kube-api-access-sjgq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:01:14.493917 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.493906    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:01:14.494068 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.493905    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81e357bd-9a25-4cae-af6c-431db34282d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 23:01:14.494068 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.493956    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "81e357bd-9a25-4cae-af6c-431db34282d3" (UID: "81e357bd-9a25-4cae-af6c-431db34282d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:01:14.509140 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.509119    2572 scope.go:117] "RemoveContainer" containerID="3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba"
Jul 20 23:01:14.516244 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.516228    2572 scope.go:117] "RemoveContainer" containerID="9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9"
Jul 20 23:01:14.516508 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:01:14.516486    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9\": container with ID starting with 9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9 not found: ID does not exist" containerID="9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9"
Jul 20 23:01:14.516568 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.516514    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9"} err="failed to get container status \"9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9\": rpc error: code = NotFound desc = could not find container \"9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9\": container with ID starting with 9e70b5cad8f6a5fd5472256d0a5972842273637f2a33a69348a1e4e8cbee90a9 not found: ID does not exist"
Jul 20 23:01:14.516568 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.516533    2572 scope.go:117] "RemoveContainer" containerID="3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba"
Jul 20 23:01:14.516809 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:01:14.516771    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba\": container with ID starting with 3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba not found: ID does not exist" containerID="3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba"
Jul 20 23:01:14.516857 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.516809    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba"} err="failed to get container status \"3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba\": rpc error: code = NotFound desc = could not find container \"3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba\": container with ID starting with 3691234037ced921ffac50ce4d1bd609b50b93512181a47d79e8c330eabe04ba not found: ID does not exist"
Jul 20 23:01:14.592543 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.592510    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81e357bd-9a25-4cae-af6c-431db34282d3-istio-podinfo\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.592543 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.592537    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81e357bd-9a25-4cae-af6c-431db34282d3-istiod-ca-cert\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.592543 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.592546    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-credential-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.592790 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.592555    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-istio-token\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.592790 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.592565    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-envoy\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.592790 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.592573    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjgq5\" (UniqueName: \"kubernetes.io/projected/81e357bd-9a25-4cae-af6c-431db34282d3-kube-api-access-sjgq5\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.592790 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.592580    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81e357bd-9a25-4cae-af6c-431db34282d3-istio-data\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:14.814169 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.814138    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"]
Jul 20 23:01:14.819628 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:14.819598    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9"]
Jul 20 23:01:15.168925 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:15.168884    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" path="/var/lib/kubelet/pods/81e357bd-9a25-4cae-af6c-431db34282d3/volumes"
Jul 20 23:01:15.410600 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:15.410561    2572 patch_prober.go:28] interesting pod/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 20 23:01:15.410801 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:15.410621    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-402b6b-openshift-default-58646f5495-pqtv9" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 20 23:01:25.131621 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.131590    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"]
Jul 20 23:01:25.132041 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.131800    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6" podUID="50128200-61cc-4cd5-9ddc-251dab9387f7" containerName="maas-api" containerID="cri-o://1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425" gracePeriod=30
Jul 20 23:01:25.160055 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.160026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:25.366104 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.366075    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:01:25.482461 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.482368    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50128200-61cc-4cd5-9ddc-251dab9387f7-openshift-service-ca\") pod \"50128200-61cc-4cd5-9ddc-251dab9387f7\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") "
Jul 20 23:01:25.482461 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.482439    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls\") pod \"50128200-61cc-4cd5-9ddc-251dab9387f7\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") "
Jul 20 23:01:25.482689 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.482467    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9zxf\" (UniqueName: \"kubernetes.io/projected/50128200-61cc-4cd5-9ddc-251dab9387f7-kube-api-access-j9zxf\") pod \"50128200-61cc-4cd5-9ddc-251dab9387f7\" (UID: \"50128200-61cc-4cd5-9ddc-251dab9387f7\") "
Jul 20 23:01:25.482794 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.482754    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50128200-61cc-4cd5-9ddc-251dab9387f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "50128200-61cc-4cd5-9ddc-251dab9387f7" (UID: "50128200-61cc-4cd5-9ddc-251dab9387f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:01:25.484567 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.484537    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "50128200-61cc-4cd5-9ddc-251dab9387f7" (UID: "50128200-61cc-4cd5-9ddc-251dab9387f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:01:25.484655 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.484580    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50128200-61cc-4cd5-9ddc-251dab9387f7-kube-api-access-j9zxf" (OuterVolumeSpecName: "kube-api-access-j9zxf") pod "50128200-61cc-4cd5-9ddc-251dab9387f7" (UID: "50128200-61cc-4cd5-9ddc-251dab9387f7"). InnerVolumeSpecName "kube-api-access-j9zxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:01:25.545027 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.544994    2572 generic.go:356] "Generic (PLEG): container finished" podID="50128200-61cc-4cd5-9ddc-251dab9387f7" containerID="1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425" exitCode=0
Jul 20 23:01:25.545171 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.545045    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"
Jul 20 23:01:25.545171 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.545074    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6" event={"ID":"50128200-61cc-4cd5-9ddc-251dab9387f7","Type":"ContainerDied","Data":"1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425"}
Jul 20 23:01:25.545171 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.545143    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6" event={"ID":"50128200-61cc-4cd5-9ddc-251dab9387f7","Type":"ContainerDied","Data":"d2a07e0c0da2d0e25bdc73b64ca369099f65dce9ba2d573e33193e1f4fdd301a"}
Jul 20 23:01:25.545171 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.545165    2572 scope.go:117] "RemoveContainer" containerID="1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425"
Jul 20 23:01:25.554160 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.554139    2572 scope.go:117] "RemoveContainer" containerID="1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425"
Jul 20 23:01:25.554409 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:01:25.554385    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425\": container with ID starting with 1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425 not found: ID does not exist" containerID="1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425"
Jul 20 23:01:25.554507 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.554417    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425"} err="failed to get container status \"1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425\": rpc error: code = NotFound desc = could not find container \"1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425\": container with ID starting with 1ca3134ef2953bbb5bc2edfee8df0c930a7993f7206969140e0435105ea7b425 not found: ID does not exist"
Jul 20 23:01:25.568217 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.568191    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"]
Jul 20 23:01:25.572559 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.572537    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d1c09f-757597bffc-jqqf6"]
Jul 20 23:01:25.583532 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.583514    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50128200-61cc-4cd5-9ddc-251dab9387f7-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:25.583600 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.583535    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50128200-61cc-4cd5-9ddc-251dab9387f7-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:25.583600 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:25.583546    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9zxf\" (UniqueName: \"kubernetes.io/projected/50128200-61cc-4cd5-9ddc-251dab9387f7-kube-api-access-j9zxf\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:01:27.168941 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:27.168907    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50128200-61cc-4cd5-9ddc-251dab9387f7" path="/var/lib/kubelet/pods/50128200-61cc-4cd5-9ddc-251dab9387f7/volumes"
Jul 20 23:01:29.608996 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:29.608960    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:30.013238 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:30.013149    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:35.804282 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:35.804237    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:35.904064 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:35.904027    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:36.073779 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.073668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:36.302246 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.302209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:36.654154 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.654116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:36.946936 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.946853    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"]
Jul 20 23:01:36.947363 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947281    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50128200-61cc-4cd5-9ddc-251dab9387f7" containerName="maas-api"
Jul 20 23:01:36.947363 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947298    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="50128200-61cc-4cd5-9ddc-251dab9387f7" containerName="maas-api"
Jul 20 23:01:36.947363 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947327    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy"
Jul 20 23:01:36.947363 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947335    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy"
Jul 20 23:01:36.947363 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947348    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy"
Jul 20 23:01:36.947363 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947357    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy"
Jul 20 23:01:36.947657 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947368    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8677813-4ee3-4eb9-86f6-773f38fa6ea0" containerName="maas-api"
Jul 20 23:01:36.947657 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947376    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8677813-4ee3-4eb9-86f6-773f38fa6ea0" containerName="maas-api"
Jul 20 23:01:36.947657 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947449    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy"
Jul 20 23:01:36.947657 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947460    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8677813-4ee3-4eb9-86f6-773f38fa6ea0" containerName="maas-api"
Jul 20 23:01:36.947657 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947469    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="50128200-61cc-4cd5-9ddc-251dab9387f7" containerName="maas-api"
Jul 20 23:01:36.947657 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.947476    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="81e357bd-9a25-4cae-af6c-431db34282d3" containerName="istio-proxy"
Jul 20 23:01:36.950385 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.950364    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:36.954651 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.954633    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 23:01:36.954999 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.954981    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-bd5746-openshift-default-dockercfg-z4wmf\""
Jul 20 23:01:36.964294 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.964264    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"]
Jul 20 23:01:36.981812 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:36.981773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:37.085528 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085493    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-istio-token\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.085528 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-socket\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.085787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb245274-f16f-424e-9441-a63fc3e23e57-istio-podinfo\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.085787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085631    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-certs\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.085787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085671    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clx8t\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-kube-api-access-clx8t\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.085787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085708    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb245274-f16f-424e-9441-a63fc3e23e57-istiod-ca-cert\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.085787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085747    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-envoy\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.085787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-credential-socket\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.086106 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.085804    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-data\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187045 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-istio-token\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187045 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187050    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-socket\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187358 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187073    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb245274-f16f-424e-9441-a63fc3e23e57-istio-podinfo\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187358 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187092    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-certs\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187358 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187215    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clx8t\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-kube-api-access-clx8t\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187358 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb245274-f16f-424e-9441-a63fc3e23e57-istiod-ca-cert\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187358 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187295    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-envoy\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187358 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187337    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-credential-socket\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187677 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187367    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-data\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187677 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187466    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-socket\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187677 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187508    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-certs\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187677 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187674    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-data\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.187923 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.187792    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-credential-socket\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.188159 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.188136    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb245274-f16f-424e-9441-a63fc3e23e57-istiod-ca-cert\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.189496 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.189468    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-envoy\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.189796 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.189779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb245274-f16f-424e-9441-a63fc3e23e57-istio-podinfo\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.195948 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.195917    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-istio-token\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.196061 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.196023    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clx8t\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-kube-api-access-clx8t\") pod \"e2e-shared-a-bd5746-openshift-default-bc59998f9-np826\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") " pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.260036 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.259952    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:37.396812 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.396781    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"]
Jul 20 23:01:37.400620 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:01:37.400594    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb245274_f16f_424e_9441_a63fc3e23e57.slice/crio-3bd024f3eddc8964c4b2c01437fe42d1552eb42fb4d520a23318d6039afd5a49 WatchSource:0}: Error finding container 3bd024f3eddc8964c4b2c01437fe42d1552eb42fb4d520a23318d6039afd5a49: Status 404 returned error can't find the container with id 3bd024f3eddc8964c4b2c01437fe42d1552eb42fb4d520a23318d6039afd5a49
Jul 20 23:01:37.402591 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.402561    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:01:37.402687 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.402627    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:01:37.402687 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.402661    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:01:37.597362 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.597331    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" event={"ID":"cb245274-f16f-424e-9441-a63fc3e23e57","Type":"ContainerStarted","Data":"4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55"}
Jul 20 23:01:37.597568 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.597397    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" event={"ID":"cb245274-f16f-424e-9441-a63fc3e23e57","Type":"ContainerStarted","Data":"3bd024f3eddc8964c4b2c01437fe42d1552eb42fb4d520a23318d6039afd5a49"}
Jul 20 23:01:37.618534 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.618481    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" podStartSLOduration=1.618466674 podStartE2EDuration="1.618466674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:01:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:01:37.617655692 +0000 UTC m=+2319.008910897" watchObservedRunningTime="2026-07-20 23:01:37.618466674 +0000 UTC m=+2319.009721870"
Jul 20 23:01:37.771281 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:37.771244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:38.260195 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:38.260154    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:38.264984 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:38.264956    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:38.601547 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:38.601510    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:38.602331 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:38.602311    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:39.658907 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.658859    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:39.748992 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.748960    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"]
Jul 20 23:01:39.751382 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.751341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:39.752477 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.752462    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:39.754954 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.754929    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-bd5746-serving-cert\""
Jul 20 23:01:39.754954 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.754951    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 23:01:39.755105 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.754980    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-69527\""
Jul 20 23:01:39.755651 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.755632    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 23:01:39.763130 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.763107    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"]
Jul 20 23:01:39.822971 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.822938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:39.910879 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.910793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:39.910879 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.910843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl7kl\" (UniqueName: \"kubernetes.io/projected/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-kube-api-access-pl7kl\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:39.910879 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:39.910863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.011579 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.011539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.011775 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.011597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl7kl\" (UniqueName: \"kubernetes.io/projected/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-kube-api-access-pl7kl\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.011775 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.011720    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.011873 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:01:40.011855    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-serving-cert: secret "maas-api-e2e-shared-a-bd5746-serving-cert" not found
Jul 20 23:01:40.011944 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:01:40.011933    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls podName:0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e nodeName:}" failed. No retries permitted until 2026-07-20 23:01:40.511905079 +0000 UTC m=+2321.903160268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls") pod "maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz" (UID: "0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e") : secret "maas-api-e2e-shared-a-bd5746-serving-cert" not found
Jul 20 23:01:40.012198 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.012179    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.020318 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.020300    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl7kl\" (UniqueName: \"kubernetes.io/projected/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-kube-api-access-pl7kl\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.181768 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.181655    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:40.516048 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.515955    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.518476 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.518449    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls\") pod \"maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.527410 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.527375    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:40.630574 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.630537    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:40.662911 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.662869    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:40.794918 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:40.794895    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"]
Jul 20 23:01:40.797182 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:01:40.797151    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4038ba_bf57_4fd2_bc3f_ab9f33c5745e.slice/crio-70a148bb49230842d26f488cf61d7ad97914351478bf7e69e66939d8bfed8b18 WatchSource:0}: Error finding container 70a148bb49230842d26f488cf61d7ad97914351478bf7e69e66939d8bfed8b18: Status 404 returned error can't find the container with id 70a148bb49230842d26f488cf61d7ad97914351478bf7e69e66939d8bfed8b18
Jul 20 23:01:41.616609 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:41.616574    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz" event={"ID":"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e","Type":"ContainerStarted","Data":"067aaf0e7eedf3b60e3db423fdfe4fd008ef2d62d3666e8f6e980b516ea99794"}
Jul 20 23:01:41.616798 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:41.616626    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz" event={"ID":"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e","Type":"ContainerStarted","Data":"70a148bb49230842d26f488cf61d7ad97914351478bf7e69e66939d8bfed8b18"}
Jul 20 23:01:41.616798 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:41.616669    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:41.633358 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:41.633299    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz" podStartSLOduration=2.178499168 podStartE2EDuration="2.633279863s" totalImagesPullingTime="454.780695ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:01:41.633084827 +0000 UTC m=+2323.024340063" watchObservedRunningTime="2026-07-20 23:01:41.633279863 +0000 UTC m=+2323.024535115"
Jul 20 23:01:44.173171 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:44.173137    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:44.514898 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:44.514795    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:44.839206 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:44.839167    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:45.246012 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:45.245915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:47.583986 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.583948    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:47.626832 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.626798    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:01:47.677908 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.677820    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:47.688976 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.688941    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"]
Jul 20 23:01:47.695004 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.694981    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.700991 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.700954    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-4a9ead-serving-cert\""
Jul 20 23:01:47.710157 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.710132    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"]
Jul 20 23:01:47.785542 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.785509    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:47.794823 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.794795    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.794958 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.794834    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.794958 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.794890    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcmkt\" (UniqueName: \"kubernetes.io/projected/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-kube-api-access-wcmkt\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.895635 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.895539    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.895635 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.895612    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.895863 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.895676    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcmkt\" (UniqueName: \"kubernetes.io/projected/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-kube-api-access-wcmkt\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.896319 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.896293    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-openshift-service-ca\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.898138 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.898114    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-maas-api-tls\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.904322 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.904298    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcmkt\" (UniqueName: \"kubernetes.io/projected/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-kube-api-access-wcmkt\") pod \"maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:47.940918 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:47.940892    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:48.013373 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:48.013336    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:48.182278 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:48.182143    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"]
Jul 20 23:01:48.192507 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:01:48.192478    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21c915a_41cb_4b5d_b936_4bf940f1c5ea.slice/crio-4adc6b083fdc40e47443379fe8805eeea4b762b6d1503909e3d9d0ef345b62e5 WatchSource:0}: Error finding container 4adc6b083fdc40e47443379fe8805eeea4b762b6d1503909e3d9d0ef345b62e5: Status 404 returned error can't find the container with id 4adc6b083fdc40e47443379fe8805eeea4b762b6d1503909e3d9d0ef345b62e5
Jul 20 23:01:48.258644 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:48.258609    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:48.359197 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:48.359159    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:48.651521 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:48.651473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk" event={"ID":"d21c915a-41cb-4b5d-b936-4bf940f1c5ea","Type":"ContainerStarted","Data":"5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655"}
Jul 20 23:01:48.652027 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:48.651570    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk" event={"ID":"d21c915a-41cb-4b5d-b936-4bf940f1c5ea","Type":"ContainerStarted","Data":"4adc6b083fdc40e47443379fe8805eeea4b762b6d1503909e3d9d0ef345b62e5"}
Jul 20 23:01:48.652027 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:48.651599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:48.670249 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:48.670182    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk" podStartSLOduration=1.391242397 podStartE2EDuration="1.670162565s" totalImagesPullingTime="278.920168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:01:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:01:48.66921836 +0000 UTC m=+2330.060473557" watchObservedRunningTime="2026-07-20 23:01:48.670162565 +0000 UTC m=+2330.061417762"
Jul 20 23:01:50.720715 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:50.720644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:50.822406 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:50.822271    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:52.055090 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:52.055048    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:01:52.671806 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:52.671726    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb245274-f16f-424e-9441-a63fc3e23e57" containerID="4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55" exitCode=0
Jul 20 23:01:52.671806 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:52.671768    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" event={"ID":"cb245274-f16f-424e-9441-a63fc3e23e57","Type":"ContainerDied","Data":"4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55"}
Jul 20 23:01:52.672162 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:52.672145    2572 scope.go:117] "RemoveContainer" containerID="4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55"
Jul 20 23:01:52.673164 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:52.673132    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:01:52.673239 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:52.673216    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:01:52.673306 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:52.673264    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 20 23:01:53.602292 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:53.602240    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:53.681019 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:53.680974    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" event={"ID":"cb245274-f16f-424e-9441-a63fc3e23e57","Type":"ContainerStarted","Data":"b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744"}
Jul 20 23:01:54.260785 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:54.260752    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:54.261897 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:54.261867    2572 patch_prober.go:28] interesting pod/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 23:01:54.262147 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:54.262119    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 23:01:54.662225 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:54.662192    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:01:55.260912 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:55.260878    2572 patch_prober.go:28] interesting pod/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 23:01:55.261096 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:55.260944    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 23:01:56.261263 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:56.261232    2572 patch_prober.go:28] interesting pod/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 23:01:56.261636 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:56.261285    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 23:01:57.261193 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:57.261151    2572 patch_prober.go:28] interesting pod/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Jul 20 23:01:57.261368 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:57.261218    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Jul 20 23:01:58.265050 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:58.265016    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:58.265510 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:58.265488    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:01:58.266234 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:01:58.266214    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:02:00.988502 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:00.988469    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"]
Jul 20 23:02:00.993828 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:00.993809    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:00.996301 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:00.996281    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"openshift-service-ca.crt\""
Jul 20 23:02:00.996471 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:00.996453    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"kube-root-ca.crt\""
Jul 20 23:02:00.997123 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:00.997108    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"default-dockercfg-g78bq\""
Jul 20 23:02:00.997217 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:00.997166    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"auth-test-model-bd5746-kserve-self-signed-certs\""
Jul 20 23:02:01.002437 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.002412    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"]
Jul 20 23:02:01.081875 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.081841    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:02:01.115463 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.115437    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-model-cache\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.115589 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.115475    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tmp-dir\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.115589 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.115497    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tls-certs\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.115589 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.115558    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-home\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.115736 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.115622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzw8v\" (UniqueName: \"kubernetes.io/projected/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-kube-api-access-tzw8v\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.115736 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.115652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-dshm\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216229 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216192    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-model-cache\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216229 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216236    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tmp-dir\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216462 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tls-certs\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216462 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216285    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-home\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216462 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216314    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzw8v\" (UniqueName: \"kubernetes.io/projected/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-kube-api-access-tzw8v\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216462 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-dshm\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216737 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216678    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tmp-dir\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216859 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216688    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-model-cache\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.216859 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.216774    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-home\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.218550 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.218529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-dshm\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.218889 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.218871    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tls-certs\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.225211 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.225186    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzw8v\" (UniqueName: \"kubernetes.io/projected/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-kube-api-access-tzw8v\") pod \"auth-test-model-bd5746-kserve-564f6ff58c-phwss\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") " pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.303719 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.303674    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:01.438640 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.438599    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"]
Jul 20 23:02:01.441763 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.441731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:02:01.442348 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:02:01.442324    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4599bf8b_3722_4c84_ad4f_bc71e8acdd60.slice/crio-87bf1679dc7943936afda0b3b20db735dca9772e3e6c253041bab7fa375e52ce WatchSource:0}: Error finding container 87bf1679dc7943936afda0b3b20db735dca9772e3e6c253041bab7fa375e52ce: Status 404 returned error can't find the container with id 87bf1679dc7943936afda0b3b20db735dca9772e3e6c253041bab7fa375e52ce
Jul 20 23:02:01.495330 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.495303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:02:01.720981 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.720880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss" event={"ID":"4599bf8b-3722-4c84-ad4f-bc71e8acdd60","Type":"ContainerStarted","Data":"975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1"}
Jul 20 23:02:01.720981 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.720943    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss" event={"ID":"4599bf8b-3722-4c84-ad4f-bc71e8acdd60","Type":"ContainerStarted","Data":"87bf1679dc7943936afda0b3b20db735dca9772e3e6c253041bab7fa375e52ce"}
Jul 20 23:02:01.741439 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:01.741382    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss" podStartSLOduration=1.741365327 podStartE2EDuration="1.741365327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:02:01.738985519 +0000 UTC m=+2343.130240715" watchObservedRunningTime="2026-07-20 23:02:01.741365327 +0000 UTC m=+2343.132620522"
Jul 20 23:02:09.025436 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:09.025396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:02:09.126718 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:09.126662    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:02:11.304689 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:11.304644    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:11.305206 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:11.304727    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:11.317135 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:11.317109    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:11.779309 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:11.779231    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:02:19.396954 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.396922    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"]
Jul 20 23:02:19.400475 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.400458    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.402872 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.402851    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"openshift-service-ca.crt\""
Jul 20 23:02:19.403018 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.402883    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"kube-root-ca.crt\""
Jul 20 23:02:19.403769 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.403750    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"default-dockercfg-kl7nf\""
Jul 20 23:02:19.403876 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.403778    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"auth-test-model-4a9ead-kserve-self-signed-certs\""
Jul 20 23:02:19.414182 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.414158    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"]
Jul 20 23:02:19.493459 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.493428    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:02:19.576476 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.576441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-home\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.576676 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.576486    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gp9l\" (UniqueName: \"kubernetes.io/projected/b8c02c45-0a4b-4480-87ca-0b59518e4337-kube-api-access-9gp9l\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.576676 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.576607    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-dshm\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.576676 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.576663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-tmp-dir\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.576876 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.576688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c02c45-0a4b-4480-87ca-0b59518e4337-tls-certs\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.576876 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.576744    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-model-cache\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.677741 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.677636    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-home\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.677741 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.677683    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gp9l\" (UniqueName: \"kubernetes.io/projected/b8c02c45-0a4b-4480-87ca-0b59518e4337-kube-api-access-9gp9l\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.677984 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.677774    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-dshm\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.677984 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.677818    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-tmp-dir\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.677984 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.677841    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c02c45-0a4b-4480-87ca-0b59518e4337-tls-certs\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.677984 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.677872    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-model-cache\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.678216 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.678058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-home\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.678284 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.678254    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-tmp-dir\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.678340 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.678288    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-model-cache\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.680180 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.680154    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-dshm\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.680344 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.680326    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c02c45-0a4b-4480-87ca-0b59518e4337-tls-certs\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.685613 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.685591    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gp9l\" (UniqueName: \"kubernetes.io/projected/b8c02c45-0a4b-4480-87ca-0b59518e4337-kube-api-access-9gp9l\") pod \"auth-test-model-4a9ead-kserve-b64f88c-lm5w7\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") " pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.710242 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.710217    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:19.839093 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:19.839067    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"]
Jul 20 23:02:19.841047 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:02:19.841006    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8c02c45_0a4b_4480_87ca_0b59518e4337.slice/crio-a81f028db8ed5fec162f7d85e8aaa5591739d580ebcd4afd1075289e5bf23f25 WatchSource:0}: Error finding container a81f028db8ed5fec162f7d85e8aaa5591739d580ebcd4afd1075289e5bf23f25: Status 404 returned error can't find the container with id a81f028db8ed5fec162f7d85e8aaa5591739d580ebcd4afd1075289e5bf23f25
Jul 20 23:02:20.808371 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:20.808336    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7" event={"ID":"b8c02c45-0a4b-4480-87ca-0b59518e4337","Type":"ContainerStarted","Data":"c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413"}
Jul 20 23:02:20.808371 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:20.808376    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7" event={"ID":"b8c02c45-0a4b-4480-87ca-0b59518e4337","Type":"ContainerStarted","Data":"a81f028db8ed5fec162f7d85e8aaa5591739d580ebcd4afd1075289e5bf23f25"}
Jul 20 23:02:20.825805 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:20.825750    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7" podStartSLOduration=1.825732809 podStartE2EDuration="1.825732809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:02:20.824456452 +0000 UTC m=+2362.215711667" watchObservedRunningTime="2026-07-20 23:02:20.825732809 +0000 UTC m=+2362.216988005"
Jul 20 23:02:24.120085 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:24.120030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:02:24.182688 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:24.182640    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:02:29.710634 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:29.710599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:29.711129 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:29.710892    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:29.723175 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:29.723155    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:02:29.857972 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:02:29.857945    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:03:09.233220 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:03:09.233175    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:03:09.292096 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:03:09.292063    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:04:24.997979 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:24.997936    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"]
Jul 20 23:04:25.036714 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:25.036669    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:04:25.798523 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:25.798486    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"]
Jul 20 23:04:25.818552 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:25.818523    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:04:40.017588 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.017545    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss" podUID="4599bf8b-3722-4c84-ad4f-bc71e8acdd60" containerName="main" containerID="cri-o://975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1" gracePeriod=45
Jul 20 23:04:40.262171 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.262144    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:04:40.324402 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.324367    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-dshm\") pod \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") "
Jul 20 23:04:40.324676 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.324447    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tls-certs\") pod \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") "
Jul 20 23:04:40.324676 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.324506    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tmp-dir\") pod \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") "
Jul 20 23:04:40.324676 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.324533    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-home\") pod \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") "
Jul 20 23:04:40.324676 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.324578    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-model-cache\") pod \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") "
Jul 20 23:04:40.324934 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.324828    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-home" (OuterVolumeSpecName: "home") pod "4599bf8b-3722-4c84-ad4f-bc71e8acdd60" (UID: "4599bf8b-3722-4c84-ad4f-bc71e8acdd60"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:04:40.324934 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.324844    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4599bf8b-3722-4c84-ad4f-bc71e8acdd60" (UID: "4599bf8b-3722-4c84-ad4f-bc71e8acdd60"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:04:40.325040 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.324972    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-model-cache" (OuterVolumeSpecName: "model-cache") pod "4599bf8b-3722-4c84-ad4f-bc71e8acdd60" (UID: "4599bf8b-3722-4c84-ad4f-bc71e8acdd60"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:04:40.326603 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.326580    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-dshm" (OuterVolumeSpecName: "dshm") pod "4599bf8b-3722-4c84-ad4f-bc71e8acdd60" (UID: "4599bf8b-3722-4c84-ad4f-bc71e8acdd60"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:04:40.326722 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.326620    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4599bf8b-3722-4c84-ad4f-bc71e8acdd60" (UID: "4599bf8b-3722-4c84-ad4f-bc71e8acdd60"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:04:40.336190 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.336168    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:04:40.399310 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.399281    2572 generic.go:356] "Generic (PLEG): container finished" podID="4599bf8b-3722-4c84-ad4f-bc71e8acdd60" containerID="975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1" exitCode=0
Jul 20 23:04:40.399485 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.399329    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"
Jul 20 23:04:40.399485 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.399365    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss" event={"ID":"4599bf8b-3722-4c84-ad4f-bc71e8acdd60","Type":"ContainerDied","Data":"975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1"}
Jul 20 23:04:40.399485 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.399408    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss" event={"ID":"4599bf8b-3722-4c84-ad4f-bc71e8acdd60","Type":"ContainerDied","Data":"87bf1679dc7943936afda0b3b20db735dca9772e3e6c253041bab7fa375e52ce"}
Jul 20 23:04:40.399485 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.399425    2572 scope.go:117] "RemoveContainer" containerID="975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1"
Jul 20 23:04:40.407502 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.407484    2572 scope.go:117] "RemoveContainer" containerID="975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1"
Jul 20 23:04:40.407820 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:04:40.407798    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1\": container with ID starting with 975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1 not found: ID does not exist" containerID="975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1"
Jul 20 23:04:40.407891 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.407840    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1"} err="failed to get container status \"975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1\": rpc error: code = NotFound desc = could not find container \"975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1\": container with ID starting with 975252c051bbddde4a5c568c3ce425bf93796e595b836b46baf68028066839c1 not found: ID does not exist"
Jul 20 23:04:40.425604 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.425583    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzw8v\" (UniqueName: \"kubernetes.io/projected/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-kube-api-access-tzw8v\") pod \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\" (UID: \"4599bf8b-3722-4c84-ad4f-bc71e8acdd60\") "
Jul 20 23:04:40.425827 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.425812    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tls-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:40.425877 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.425829    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-tmp-dir\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:40.425877 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.425837    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-home\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:40.425877 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.425845    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-model-cache\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:40.425877 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.425852    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-dshm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:40.427567 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.427546    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-kube-api-access-tzw8v" (OuterVolumeSpecName: "kube-api-access-tzw8v") pod "4599bf8b-3722-4c84-ad4f-bc71e8acdd60" (UID: "4599bf8b-3722-4c84-ad4f-bc71e8acdd60"). InnerVolumeSpecName "kube-api-access-tzw8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:04:40.527186 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.527149    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzw8v\" (UniqueName: \"kubernetes.io/projected/4599bf8b-3722-4c84-ad4f-bc71e8acdd60-kube-api-access-tzw8v\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:40.722041 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.722000    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"]
Jul 20 23:04:40.726054 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.726015    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/auth-test-model-bd5746-kserve-564f6ff58c-phwss"]
Jul 20 23:04:40.818526 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:40.818456    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7" podUID="b8c02c45-0a4b-4480-87ca-0b59518e4337" containerName="main" containerID="cri-o://c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413" gracePeriod=45
Jul 20 23:04:41.077050 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.077021    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:04:41.132828 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.132794    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-home\") pod \"b8c02c45-0a4b-4480-87ca-0b59518e4337\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") "
Jul 20 23:04:41.132997 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.132850    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-tmp-dir\") pod \"b8c02c45-0a4b-4480-87ca-0b59518e4337\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") "
Jul 20 23:04:41.132997 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.132879    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gp9l\" (UniqueName: \"kubernetes.io/projected/b8c02c45-0a4b-4480-87ca-0b59518e4337-kube-api-access-9gp9l\") pod \"b8c02c45-0a4b-4480-87ca-0b59518e4337\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") "
Jul 20 23:04:41.132997 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.132977    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c02c45-0a4b-4480-87ca-0b59518e4337-tls-certs\") pod \"b8c02c45-0a4b-4480-87ca-0b59518e4337\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") "
Jul 20 23:04:41.133138 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.132999    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-model-cache\") pod \"b8c02c45-0a4b-4480-87ca-0b59518e4337\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") "
Jul 20 23:04:41.133138 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.133053    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-dshm\") pod \"b8c02c45-0a4b-4480-87ca-0b59518e4337\" (UID: \"b8c02c45-0a4b-4480-87ca-0b59518e4337\") "
Jul 20 23:04:41.133138 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.133116    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8c02c45-0a4b-4480-87ca-0b59518e4337" (UID: "b8c02c45-0a4b-4480-87ca-0b59518e4337"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:04:41.133138 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.133130    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-home" (OuterVolumeSpecName: "home") pod "b8c02c45-0a4b-4480-87ca-0b59518e4337" (UID: "b8c02c45-0a4b-4480-87ca-0b59518e4337"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:04:41.133348 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.133229    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8c02c45-0a4b-4480-87ca-0b59518e4337" (UID: "b8c02c45-0a4b-4480-87ca-0b59518e4337"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:04:41.133455 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.133341    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-model-cache\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:41.133455 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.133366    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-home\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:41.133455 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.133380    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-tmp-dir\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:41.135195 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.135171    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-dshm" (OuterVolumeSpecName: "dshm") pod "b8c02c45-0a4b-4480-87ca-0b59518e4337" (UID: "b8c02c45-0a4b-4480-87ca-0b59518e4337"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:04:41.135294 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.135242    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c02c45-0a4b-4480-87ca-0b59518e4337-kube-api-access-9gp9l" (OuterVolumeSpecName: "kube-api-access-9gp9l") pod "b8c02c45-0a4b-4480-87ca-0b59518e4337" (UID: "b8c02c45-0a4b-4480-87ca-0b59518e4337"). InnerVolumeSpecName "kube-api-access-9gp9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:04:41.135336 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.135293    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8c02c45-0a4b-4480-87ca-0b59518e4337-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8c02c45-0a4b-4480-87ca-0b59518e4337" (UID: "b8c02c45-0a4b-4480-87ca-0b59518e4337"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:04:41.169126 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.169093    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4599bf8b-3722-4c84-ad4f-bc71e8acdd60" path="/var/lib/kubelet/pods/4599bf8b-3722-4c84-ad4f-bc71e8acdd60/volumes"
Jul 20 23:04:41.234640 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.234604    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c02c45-0a4b-4480-87ca-0b59518e4337-tls-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:41.234640 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.234637    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c02c45-0a4b-4480-87ca-0b59518e4337-dshm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:41.234640 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.234646    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gp9l\" (UniqueName: \"kubernetes.io/projected/b8c02c45-0a4b-4480-87ca-0b59518e4337-kube-api-access-9gp9l\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:04:41.405513 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.405476    2572 generic.go:356] "Generic (PLEG): container finished" podID="b8c02c45-0a4b-4480-87ca-0b59518e4337" containerID="c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413" exitCode=0
Jul 20 23:04:41.405681 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.405519    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"
Jul 20 23:04:41.405681 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.405541    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7" event={"ID":"b8c02c45-0a4b-4480-87ca-0b59518e4337","Type":"ContainerDied","Data":"c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413"}
Jul 20 23:04:41.405681 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.405571    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7" event={"ID":"b8c02c45-0a4b-4480-87ca-0b59518e4337","Type":"ContainerDied","Data":"a81f028db8ed5fec162f7d85e8aaa5591739d580ebcd4afd1075289e5bf23f25"}
Jul 20 23:04:41.405681 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.405587    2572 scope.go:117] "RemoveContainer" containerID="c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413"
Jul 20 23:04:41.414179 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.414161    2572 scope.go:117] "RemoveContainer" containerID="c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413"
Jul 20 23:04:41.414422 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:04:41.414401    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413\": container with ID starting with c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413 not found: ID does not exist" containerID="c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413"
Jul 20 23:04:41.414468 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.414431    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413"} err="failed to get container status \"c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413\": rpc error: code = NotFound desc = could not find container \"c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413\": container with ID starting with c383f217f58bcb4673f9da4a7e6050a35606bd74b70c595b2fe862b683006413 not found: ID does not exist"
Jul 20 23:04:41.420401 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.420379    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"]
Jul 20 23:04:41.424033 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:41.424009    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/auth-test-model-4a9ead-kserve-b64f88c-lm5w7"]
Jul 20 23:04:43.168989 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:04:43.168956    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8c02c45-0a4b-4480-87ca-0b59518e4337" path="/var/lib/kubelet/pods/b8c02c45-0a4b-4480-87ca-0b59518e4337/volumes"
Jul 20 23:05:14.597074 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.597036    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"]
Jul 20 23:05:14.597565 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.597379    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4599bf8b-3722-4c84-ad4f-bc71e8acdd60" containerName="main"
Jul 20 23:05:14.597565 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.597391    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4599bf8b-3722-4c84-ad4f-bc71e8acdd60" containerName="main"
Jul 20 23:05:14.597565 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.597408    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c02c45-0a4b-4480-87ca-0b59518e4337" containerName="main"
Jul 20 23:05:14.597565 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.597413    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c02c45-0a4b-4480-87ca-0b59518e4337" containerName="main"
Jul 20 23:05:14.597565 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.597466    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4599bf8b-3722-4c84-ad4f-bc71e8acdd60" containerName="main"
Jul 20 23:05:14.597565 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.597477    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c02c45-0a4b-4480-87ca-0b59518e4337" containerName="main"
Jul 20 23:05:14.600370 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.600352    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.602720 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.602703    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"kube-root-ca.crt\""
Jul 20 23:05:14.603561 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.603543    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"default-dockercfg-kl7nf\""
Jul 20 23:05:14.603651 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.603603    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"openshift-service-ca.crt\""
Jul 20 23:05:14.603651 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.603617    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"sub-test-model-4a9ead-kserve-self-signed-certs\""
Jul 20 23:05:14.610039 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.610020    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"]
Jul 20 23:05:14.693958 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.693919    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:05:14.727546 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.727518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-dshm\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.727546 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.727549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tls-certs\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.727797 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.727581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-home\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.727797 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.727600    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tmp-dir\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.727797 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.727633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnml6\" (UniqueName: \"kubernetes.io/projected/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-kube-api-access-dnml6\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.727924 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.727795    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-model-cache\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.828490 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.828444    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-dshm\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.828490 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.828487    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tls-certs\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.828775 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.828524    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-home\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.828775 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.828543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tmp-dir\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.828775 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.828561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnml6\" (UniqueName: \"kubernetes.io/projected/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-kube-api-access-dnml6\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.828775 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.828620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-model-cache\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.828998 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.828973    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-home\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.829050 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.829000    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tmp-dir\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.829088 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.829053    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-model-cache\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.830801 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.830779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-dshm\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.830910 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.830892    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tls-certs\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.837065 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.837042    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnml6\" (UniqueName: \"kubernetes.io/projected/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-kube-api-access-dnml6\") pod \"sub-test-model-4a9ead-kserve-769d6b4455-dss4n\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") " pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:14.910287 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:14.910183    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:15.035139 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:15.035115    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"]
Jul 20 23:05:15.037644 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:05:15.037617    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d4bccca_58ac_4a1b_b98d_dab9e47e05f0.slice/crio-6ea9a059342c58093a816c5cdbd7a137b175d525c8b004c936069fe96df44e95 WatchSource:0}: Error finding container 6ea9a059342c58093a816c5cdbd7a137b175d525c8b004c936069fe96df44e95: Status 404 returned error can't find the container with id 6ea9a059342c58093a816c5cdbd7a137b175d525c8b004c936069fe96df44e95
Jul 20 23:05:15.543227 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:15.543192    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n" event={"ID":"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0","Type":"ContainerStarted","Data":"8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4"}
Jul 20 23:05:15.543397 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:15.543238    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n" event={"ID":"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0","Type":"ContainerStarted","Data":"6ea9a059342c58093a816c5cdbd7a137b175d525c8b004c936069fe96df44e95"}
Jul 20 23:05:15.560730 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:15.560668    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n" podStartSLOduration=1.560654132 podStartE2EDuration="1.560654132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:05:15.559493502 +0000 UTC m=+2536.950748697" watchObservedRunningTime="2026-07-20 23:05:15.560654132 +0000 UTC m=+2536.951909327"
Jul 20 23:05:24.910721 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:24.910664    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:24.911140 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:24.910739    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:24.922687 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:24.922659    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:25.595966 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:25.595927    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:05:36.729806 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:36.729764    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:05:38.853521 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:38.853491    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:05:55.922808 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:55.922772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:05:56.772381 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:56.772344    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"]
Jul 20 23:05:56.783292 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:05:56.783257    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:06:08.738259 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:08.738220    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:06:11.792180 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:11.792128    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n" podUID="1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" containerName="main" containerID="cri-o://8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4" gracePeriod=45
Jul 20 23:06:12.046026 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.045953    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:06:12.236963 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.236911    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tls-certs\") pod \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") "
Jul 20 23:06:12.237160 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.236978    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnml6\" (UniqueName: \"kubernetes.io/projected/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-kube-api-access-dnml6\") pod \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") "
Jul 20 23:06:12.237160 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.237024    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-home\") pod \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") "
Jul 20 23:06:12.237160 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.237111    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-dshm\") pod \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") "
Jul 20 23:06:12.237160 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.237138    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tmp-dir\") pod \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") "
Jul 20 23:06:12.237389 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.237173    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-model-cache\") pod \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\" (UID: \"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0\") "
Jul 20 23:06:12.237454 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.237400    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-home" (OuterVolumeSpecName: "home") pod "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" (UID: "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:06:12.237873 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.237834    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" (UID: "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:06:12.238005 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.237975    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" (UID: "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:06:12.239490 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.239465    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" (UID: "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:06:12.239670 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.239650    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-dshm" (OuterVolumeSpecName: "dshm") pod "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" (UID: "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:06:12.239795 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.239652    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-kube-api-access-dnml6" (OuterVolumeSpecName: "kube-api-access-dnml6") pod "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" (UID: "1d4bccca-58ac-4a1b-b98d-dab9e47e05f0"). InnerVolumeSpecName "kube-api-access-dnml6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:06:12.338260 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.338222    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tls-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:06:12.338260 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.338256    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnml6\" (UniqueName: \"kubernetes.io/projected/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-kube-api-access-dnml6\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:06:12.338260 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.338266    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-home\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:06:12.338500 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.338274    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-dshm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:06:12.338500 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.338303    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-tmp-dir\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:06:12.338500 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.338311    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0-model-cache\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:06:12.784210 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.784117    2572 generic.go:356] "Generic (PLEG): container finished" podID="1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" containerID="8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4" exitCode=0
Jul 20 23:06:12.784210 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.784166    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"
Jul 20 23:06:12.784210 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.784170    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n" event={"ID":"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0","Type":"ContainerDied","Data":"8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4"}
Jul 20 23:06:12.784471 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.784212    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n" event={"ID":"1d4bccca-58ac-4a1b-b98d-dab9e47e05f0","Type":"ContainerDied","Data":"6ea9a059342c58093a816c5cdbd7a137b175d525c8b004c936069fe96df44e95"}
Jul 20 23:06:12.784471 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.784232    2572 scope.go:117] "RemoveContainer" containerID="8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4"
Jul 20 23:06:12.793231 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.793040    2572 scope.go:117] "RemoveContainer" containerID="8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4"
Jul 20 23:06:12.793464 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:06:12.793281    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4\": container with ID starting with 8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4 not found: ID does not exist" containerID="8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4"
Jul 20 23:06:12.793464 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.793305    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4"} err="failed to get container status \"8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4\": rpc error: code = NotFound desc = could not find container \"8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4\": container with ID starting with 8cf463625cf85cbf7d927e6657920c0fe7c4c151a37425eeddabe85b4ae589f4 not found: ID does not exist"
Jul 20 23:06:12.805102 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.805076    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"]
Jul 20 23:06:12.811130 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:12.811107    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/sub-test-model-4a9ead-kserve-769d6b4455-dss4n"]
Jul 20 23:06:13.170305 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:13.170264    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" path="/var/lib/kubelet/pods/1d4bccca-58ac-4a1b-b98d-dab9e47e05f0/volumes"
Jul 20 23:06:34.639911 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.639819    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"]
Jul 20 23:06:34.640464 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.640273    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" containerName="main"
Jul 20 23:06:34.640464 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.640292    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" containerName="main"
Jul 20 23:06:34.640464 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.640391    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d4bccca-58ac-4a1b-b98d-dab9e47e05f0" containerName="main"
Jul 20 23:06:34.644726 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.644684    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.648566 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.648541    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"kube-root-ca.crt\""
Jul 20 23:06:34.649501 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.649482    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"rate-test-model-4a9ead-kserve-self-signed-certs\""
Jul 20 23:06:34.649596 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.649506    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"openshift-service-ca.crt\""
Jul 20 23:06:34.649641 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.649619    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4a9ead\"/\"default-dockercfg-kl7nf\""
Jul 20 23:06:34.665851 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.665812    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"]
Jul 20 23:06:34.671718 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.671671    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:06:34.733066 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.733030    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldphm\" (UniqueName: \"kubernetes.io/projected/2c6b441c-3455-468f-b382-878cad5c687e-kube-api-access-ldphm\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.733066 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.733070    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-tmp-dir\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.733294 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.733095    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-model-cache\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.733294 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.733150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-home\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.733294 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.733177    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-dshm\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.733294 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.733231    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6b441c-3455-468f-b382-878cad5c687e-tls-certs\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834084 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6b441c-3455-468f-b382-878cad5c687e-tls-certs\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834277 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834137    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldphm\" (UniqueName: \"kubernetes.io/projected/2c6b441c-3455-468f-b382-878cad5c687e-kube-api-access-ldphm\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834277 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834167    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-tmp-dir\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834277 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834202    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-model-cache\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834277 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-home\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834277 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-dshm\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834666 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834639    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-home\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834794 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-model-cache\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.834794 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.834756    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-tmp-dir\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.836504 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.836475    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-dshm\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.836630 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.836615    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6b441c-3455-468f-b382-878cad5c687e-tls-certs\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.842474 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.842451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldphm\" (UniqueName: \"kubernetes.io/projected/2c6b441c-3455-468f-b382-878cad5c687e-kube-api-access-ldphm\") pod \"rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") " pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:34.953765 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:34.953722    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:35.087254 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:35.087228    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"]
Jul 20 23:06:35.089500 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:06:35.089472    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c6b441c_3455_468f_b382_878cad5c687e.slice/crio-504103fb4430b46cfc6d3f09fc62a8fc68f0f94bea8250281d4430d7a439c358 WatchSource:0}: Error finding container 504103fb4430b46cfc6d3f09fc62a8fc68f0f94bea8250281d4430d7a439c358: Status 404 returned error can't find the container with id 504103fb4430b46cfc6d3f09fc62a8fc68f0f94bea8250281d4430d7a439c358
Jul 20 23:06:35.881103 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:35.881071    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66" event={"ID":"2c6b441c-3455-468f-b382-878cad5c687e","Type":"ContainerStarted","Data":"e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d"}
Jul 20 23:06:35.881527 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:35.881113    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66" event={"ID":"2c6b441c-3455-468f-b382-878cad5c687e","Type":"ContainerStarted","Data":"504103fb4430b46cfc6d3f09fc62a8fc68f0f94bea8250281d4430d7a439c358"}
Jul 20 23:06:35.897816 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:35.897755    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66" podStartSLOduration=1.897733127 podStartE2EDuration="1.897733127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:06:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:06:35.896995696 +0000 UTC m=+2617.288250891" watchObservedRunningTime="2026-07-20 23:06:35.897733127 +0000 UTC m=+2617.288988324"
Jul 20 23:06:44.954768 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:44.954731    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:44.955176 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:44.954783    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:44.968929 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:44.968901    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:45.933568 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:45.933534    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:06:51.495279 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:51.495236    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:06:51.596802 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:51.596759    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:06:59.360540 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:06:59.360496    2572 scope.go:117] "RemoveContainer" containerID="518cb6f4b02fb7b5c516e7a5f610e8cabe299d4ff17440f67b72b0fa86ffa6e2"
Jul 20 23:07:02.249403 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:02.249353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:02.349502 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:02.349461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:10.044154 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:10.044114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:10.144334 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:10.144290    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:20.521431 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:20.521394    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:21.601384 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:21.601350    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"]
Jul 20 23:07:21.621239 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:21.621189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:28.859593 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:28.859555    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7410-140008228794704"]
Jul 20 23:07:28.862846 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:28.862820    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228794704"
Jul 20 23:07:28.865082 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:28.865060    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-grsb4\""
Jul 20 23:07:28.868447 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:28.868426    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7410-140008228794704"]
Jul 20 23:07:28.985626 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:28.985585    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lgp2\" (UniqueName: \"kubernetes.io/projected/18a8076e-6b3c-4bee-803c-9f29220553b1-kube-api-access-9lgp2\") pod \"test-curl-7410-140008228794704\" (UID: \"18a8076e-6b3c-4bee-803c-9f29220553b1\") " pod="opendatahub/test-curl-7410-140008228794704"
Jul 20 23:07:29.086158 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:29.086122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lgp2\" (UniqueName: \"kubernetes.io/projected/18a8076e-6b3c-4bee-803c-9f29220553b1-kube-api-access-9lgp2\") pod \"test-curl-7410-140008228794704\" (UID: \"18a8076e-6b3c-4bee-803c-9f29220553b1\") " pod="opendatahub/test-curl-7410-140008228794704"
Jul 20 23:07:29.095703 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:29.095671    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lgp2\" (UniqueName: \"kubernetes.io/projected/18a8076e-6b3c-4bee-803c-9f29220553b1-kube-api-access-9lgp2\") pod \"test-curl-7410-140008228794704\" (UID: \"18a8076e-6b3c-4bee-803c-9f29220553b1\") " pod="opendatahub/test-curl-7410-140008228794704"
Jul 20 23:07:29.173801 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:29.173726    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228794704"
Jul 20 23:07:29.303661 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:29.303631    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7410-140008228794704"]
Jul 20 23:07:29.306254 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:07:29.306224    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18a8076e_6b3c_4bee_803c_9f29220553b1.slice/crio-94e31521abc75f196ddf8cff7d5524b34fded9c6f6b90fc590e39ecedba23dfa WatchSource:0}: Error finding container 94e31521abc75f196ddf8cff7d5524b34fded9c6f6b90fc590e39ecedba23dfa: Status 404 returned error can't find the container with id 94e31521abc75f196ddf8cff7d5524b34fded9c6f6b90fc590e39ecedba23dfa
Jul 20 23:07:29.307569 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:29.307549    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 23:07:30.112869 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:30.112836    2572 generic.go:356] "Generic (PLEG): container finished" podID="18a8076e-6b3c-4bee-803c-9f29220553b1" containerID="c33b55037abdf6ad286db725f47f6b593d1db9720df60f1ac35c93fa15212c5d" exitCode=0
Jul 20 23:07:30.113209 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:30.112897    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7410-140008228794704" event={"ID":"18a8076e-6b3c-4bee-803c-9f29220553b1","Type":"ContainerDied","Data":"c33b55037abdf6ad286db725f47f6b593d1db9720df60f1ac35c93fa15212c5d"}
Jul 20 23:07:30.113209 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:30.112925    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7410-140008228794704" event={"ID":"18a8076e-6b3c-4bee-803c-9f29220553b1","Type":"ContainerStarted","Data":"94e31521abc75f196ddf8cff7d5524b34fded9c6f6b90fc590e39ecedba23dfa"}
Jul 20 23:07:31.242483 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:31.242446    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228794704"
Jul 20 23:07:31.263984 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:31.263954    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7410-140008228794704_18a8076e-6b3c-4bee-803c-9f29220553b1/test-curl-7410-140008228794704/0.log"
Jul 20 23:07:31.289599 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:31.289569    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7410-140008228794704"]
Jul 20 23:07:31.295024 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:31.295001    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7410-140008228794704"]
Jul 20 23:07:31.304563 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:31.304546    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lgp2\" (UniqueName: \"kubernetes.io/projected/18a8076e-6b3c-4bee-803c-9f29220553b1-kube-api-access-9lgp2\") pod \"18a8076e-6b3c-4bee-803c-9f29220553b1\" (UID: \"18a8076e-6b3c-4bee-803c-9f29220553b1\") "
Jul 20 23:07:31.306648 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:31.306621    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a8076e-6b3c-4bee-803c-9f29220553b1-kube-api-access-9lgp2" (OuterVolumeSpecName: "kube-api-access-9lgp2") pod "18a8076e-6b3c-4bee-803c-9f29220553b1" (UID: "18a8076e-6b3c-4bee-803c-9f29220553b1"). InnerVolumeSpecName "kube-api-access-9lgp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:07:31.406126 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:31.406027    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lgp2\" (UniqueName: \"kubernetes.io/projected/18a8076e-6b3c-4bee-803c-9f29220553b1-kube-api-access-9lgp2\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:32.123262 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:32.123234    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94e31521abc75f196ddf8cff7d5524b34fded9c6f6b90fc590e39ecedba23dfa"
Jul 20 23:07:32.123262 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:32.123249    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228794704"
Jul 20 23:07:32.133202 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:07:32.133170    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7410-140008228794704\" is forbidden: User \"system:node:ip-10-0-136-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-15.ec2.internal' and this object" podUID="18a8076e-6b3c-4bee-803c-9f29220553b1" pod="opendatahub/test-curl-7410-140008228794704"
Jul 20 23:07:33.169162 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.169126    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a8076e-6b3c-4bee-803c-9f29220553b1" path="/var/lib/kubelet/pods/18a8076e-6b3c-4bee-803c-9f29220553b1/volumes"
Jul 20 23:07:33.837035 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.837004    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:33.837318 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.837305    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a8076e-6b3c-4bee-803c-9f29220553b1" containerName="test-curl-7410-140008228794704"
Jul 20 23:07:33.837363 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.837319    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a8076e-6b3c-4bee-803c-9f29220553b1" containerName="test-curl-7410-140008228794704"
Jul 20 23:07:33.837395 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.837378    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a8076e-6b3c-4bee-803c-9f29220553b1" containerName="test-curl-7410-140008228794704"
Jul 20 23:07:33.840393 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.840373    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:33.842800 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.842778    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-grsb4\""
Jul 20 23:07:33.847481 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.847455    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:33.926356 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:33.926317    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9v4t\" (UniqueName: \"kubernetes.io/projected/4f0ce929-2bbd-4b79-aa5c-7c2089023dc2-kube-api-access-z9v4t\") pod \"test-curl-7410-140008228717600\" (UID: \"4f0ce929-2bbd-4b79-aa5c-7c2089023dc2\") " pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:34.026765 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:34.026724    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9v4t\" (UniqueName: \"kubernetes.io/projected/4f0ce929-2bbd-4b79-aa5c-7c2089023dc2-kube-api-access-z9v4t\") pod \"test-curl-7410-140008228717600\" (UID: \"4f0ce929-2bbd-4b79-aa5c-7c2089023dc2\") " pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:34.035640 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:34.035608    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9v4t\" (UniqueName: \"kubernetes.io/projected/4f0ce929-2bbd-4b79-aa5c-7c2089023dc2-kube-api-access-z9v4t\") pod \"test-curl-7410-140008228717600\" (UID: \"4f0ce929-2bbd-4b79-aa5c-7c2089023dc2\") " pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:34.150236 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:34.150151    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:34.275318 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:34.275249    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:34.277620 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:07:34.277589    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f0ce929_2bbd_4b79_aa5c_7c2089023dc2.slice/crio-2c2b149e6c494d8791e0bb8ea1d57af957d8cb7b9ff34f0459723d7c9f6a8f8c WatchSource:0}: Error finding container 2c2b149e6c494d8791e0bb8ea1d57af957d8cb7b9ff34f0459723d7c9f6a8f8c: Status 404 returned error can't find the container with id 2c2b149e6c494d8791e0bb8ea1d57af957d8cb7b9ff34f0459723d7c9f6a8f8c
Jul 20 23:07:35.137682 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:35.137644    2572 generic.go:356] "Generic (PLEG): container finished" podID="4f0ce929-2bbd-4b79-aa5c-7c2089023dc2" containerID="59a7639c3beb8f565fd8f8731b727bfbaf01a1b71cd28487daecc2c923c4dd50" exitCode=0
Jul 20 23:07:35.137869 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:35.137732    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7410-140008228717600" event={"ID":"4f0ce929-2bbd-4b79-aa5c-7c2089023dc2","Type":"ContainerDied","Data":"59a7639c3beb8f565fd8f8731b727bfbaf01a1b71cd28487daecc2c923c4dd50"}
Jul 20 23:07:35.137869 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:35.137776    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7410-140008228717600" event={"ID":"4f0ce929-2bbd-4b79-aa5c-7c2089023dc2","Type":"ContainerStarted","Data":"2c2b149e6c494d8791e0bb8ea1d57af957d8cb7b9ff34f0459723d7c9f6a8f8c"}
Jul 20 23:07:36.270984 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.270960    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:36.290776 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.290751    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7410-140008228717600_4f0ce929-2bbd-4b79-aa5c-7c2089023dc2/test-curl-7410-140008228717600/0.log"
Jul 20 23:07:36.314747 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.314721    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:36.319848 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.319822    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:36.347418 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.347392    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9v4t\" (UniqueName: \"kubernetes.io/projected/4f0ce929-2bbd-4b79-aa5c-7c2089023dc2-kube-api-access-z9v4t\") pod \"4f0ce929-2bbd-4b79-aa5c-7c2089023dc2\" (UID: \"4f0ce929-2bbd-4b79-aa5c-7c2089023dc2\") "
Jul 20 23:07:36.349429 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.349405    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0ce929-2bbd-4b79-aa5c-7c2089023dc2-kube-api-access-z9v4t" (OuterVolumeSpecName: "kube-api-access-z9v4t") pod "4f0ce929-2bbd-4b79-aa5c-7c2089023dc2" (UID: "4f0ce929-2bbd-4b79-aa5c-7c2089023dc2"). InnerVolumeSpecName "kube-api-access-z9v4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:07:36.448199 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.448127    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9v4t\" (UniqueName: \"kubernetes.io/projected/4f0ce929-2bbd-4b79-aa5c-7c2089023dc2-kube-api-access-z9v4t\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:36.621098 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.621028    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66" podUID="2c6b441c-3455-468f-b382-878cad5c687e" containerName="main" containerID="cri-o://e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d" gracePeriod=45
Jul 20 23:07:36.868458 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.868432    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:07:36.953033 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.952999    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-home\") pod \"2c6b441c-3455-468f-b382-878cad5c687e\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") "
Jul 20 23:07:36.953213 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953046    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-model-cache\") pod \"2c6b441c-3455-468f-b382-878cad5c687e\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") "
Jul 20 23:07:36.953213 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953077    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-dshm\") pod \"2c6b441c-3455-468f-b382-878cad5c687e\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") "
Jul 20 23:07:36.953213 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953143    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldphm\" (UniqueName: \"kubernetes.io/projected/2c6b441c-3455-468f-b382-878cad5c687e-kube-api-access-ldphm\") pod \"2c6b441c-3455-468f-b382-878cad5c687e\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") "
Jul 20 23:07:36.953213 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953170    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6b441c-3455-468f-b382-878cad5c687e-tls-certs\") pod \"2c6b441c-3455-468f-b382-878cad5c687e\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") "
Jul 20 23:07:36.953213 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953204    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-tmp-dir\") pod \"2c6b441c-3455-468f-b382-878cad5c687e\" (UID: \"2c6b441c-3455-468f-b382-878cad5c687e\") "
Jul 20 23:07:36.953470 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953284    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-home" (OuterVolumeSpecName: "home") pod "2c6b441c-3455-468f-b382-878cad5c687e" (UID: "2c6b441c-3455-468f-b382-878cad5c687e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:36.953470 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-model-cache" (OuterVolumeSpecName: "model-cache") pod "2c6b441c-3455-468f-b382-878cad5c687e" (UID: "2c6b441c-3455-468f-b382-878cad5c687e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:36.953586 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953545    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-home\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:36.953586 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953564    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-model-cache\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:36.953586 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.953560    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2c6b441c-3455-468f-b382-878cad5c687e" (UID: "2c6b441c-3455-468f-b382-878cad5c687e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:36.955253 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.955222    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-dshm" (OuterVolumeSpecName: "dshm") pod "2c6b441c-3455-468f-b382-878cad5c687e" (UID: "2c6b441c-3455-468f-b382-878cad5c687e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:36.955381 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.955318    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c6b441c-3455-468f-b382-878cad5c687e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2c6b441c-3455-468f-b382-878cad5c687e" (UID: "2c6b441c-3455-468f-b382-878cad5c687e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:07:36.955381 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:36.955330    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c6b441c-3455-468f-b382-878cad5c687e-kube-api-access-ldphm" (OuterVolumeSpecName: "kube-api-access-ldphm") pod "2c6b441c-3455-468f-b382-878cad5c687e" (UID: "2c6b441c-3455-468f-b382-878cad5c687e"). InnerVolumeSpecName "kube-api-access-ldphm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:07:37.054899 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.054867    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldphm\" (UniqueName: \"kubernetes.io/projected/2c6b441c-3455-468f-b382-878cad5c687e-kube-api-access-ldphm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:37.054899 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.054900    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c6b441c-3455-468f-b382-878cad5c687e-tls-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:37.055080 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.054912    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-tmp-dir\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:37.055080 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.054922    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c6b441c-3455-468f-b382-878cad5c687e-dshm\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:37.147056 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.147013    2572 generic.go:356] "Generic (PLEG): container finished" podID="2c6b441c-3455-468f-b382-878cad5c687e" containerID="e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d" exitCode=0
Jul 20 23:07:37.147056 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.147061    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"
Jul 20 23:07:37.147265 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.147089    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66" event={"ID":"2c6b441c-3455-468f-b382-878cad5c687e","Type":"ContainerDied","Data":"e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d"}
Jul 20 23:07:37.147265 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.147130    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66" event={"ID":"2c6b441c-3455-468f-b382-878cad5c687e","Type":"ContainerDied","Data":"504103fb4430b46cfc6d3f09fc62a8fc68f0f94bea8250281d4430d7a439c358"}
Jul 20 23:07:37.147265 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.147148    2572 scope.go:117] "RemoveContainer" containerID="e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d"
Jul 20 23:07:37.148508 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.148465    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c2b149e6c494d8791e0bb8ea1d57af957d8cb7b9ff34f0459723d7c9f6a8f8c"
Jul 20 23:07:37.148508 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.148493    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:37.155755 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.155591    2572 scope.go:117] "RemoveContainer" containerID="e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d"
Jul 20 23:07:37.156069 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:07:37.156042    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d\": container with ID starting with e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d not found: ID does not exist" containerID="e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d"
Jul 20 23:07:37.156169 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.156080    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d"} err="failed to get container status \"e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d\": rpc error: code = NotFound desc = could not find container \"e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d\": container with ID starting with e628f009388d0b3d769fd3aea3ffabae0463b0f17ce981cf4e44eeee77d17b8d not found: ID does not exist"
Jul 20 23:07:37.169554 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.169530    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f0ce929-2bbd-4b79-aa5c-7c2089023dc2" path="/var/lib/kubelet/pods/4f0ce929-2bbd-4b79-aa5c-7c2089023dc2/volumes"
Jul 20 23:07:37.170398 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.170378    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"]
Jul 20 23:07:37.174137 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:37.174118    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4a9ead/rate-test-model-4a9ead-kserve-7cb8758cf9-4gd66"]
Jul 20 23:07:37.174445 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:07:37.174422    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7410-140008228717600\" is forbidden: User \"system:node:ip-10-0-136-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-15.ec2.internal' and this object" podUID="4f0ce929-2bbd-4b79-aa5c-7c2089023dc2" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:39.169064 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:39.169029    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c6b441c-3455-468f-b382-878cad5c687e" path="/var/lib/kubelet/pods/2c6b441c-3455-468f-b382-878cad5c687e/volumes"
Jul 20 23:07:39.960302 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:39.960262    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:40.059517 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:40.059475    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:40.187933 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:40.187894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:49.840300 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:49.840269    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"]
Jul 20 23:07:49.840860 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:49.840483    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz" podUID="0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" containerName="maas-api" containerID="cri-o://067aaf0e7eedf3b60e3db423fdfe4fd008ef2d62d3666e8f6e980b516ea99794" gracePeriod=30
Jul 20 23:07:49.861063 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:49.861030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:50.205517 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.205481    2572 generic.go:356] "Generic (PLEG): container finished" podID="0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" containerID="067aaf0e7eedf3b60e3db423fdfe4fd008ef2d62d3666e8f6e980b516ea99794" exitCode=0
Jul 20 23:07:50.205653 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.205633    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz" event={"ID":"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e","Type":"ContainerDied","Data":"067aaf0e7eedf3b60e3db423fdfe4fd008ef2d62d3666e8f6e980b516ea99794"}
Jul 20 23:07:50.287215 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.287192    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:07:50.370418 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.370332    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl7kl\" (UniqueName: \"kubernetes.io/projected/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-kube-api-access-pl7kl\") pod \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") "
Jul 20 23:07:50.370418 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.370377    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls\") pod \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") "
Jul 20 23:07:50.370596 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.370422    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-openshift-service-ca\") pod \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\" (UID: \"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e\") "
Jul 20 23:07:50.370858 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.370828    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" (UID: "0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:07:50.372413 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.372382    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" (UID: "0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:07:50.372520 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.372471    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-kube-api-access-pl7kl" (OuterVolumeSpecName: "kube-api-access-pl7kl") pod "0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" (UID: "0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e"). InnerVolumeSpecName "kube-api-access-pl7kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:07:50.471044 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.471013    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:50.471044 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.471043    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl7kl\" (UniqueName: \"kubernetes.io/projected/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-kube-api-access-pl7kl\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:50.471233 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:50.471053    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:07:51.211911 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:51.211883    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"
Jul 20 23:07:51.212308 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:51.211921    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz" event={"ID":"0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e","Type":"ContainerDied","Data":"70a148bb49230842d26f488cf61d7ad97914351478bf7e69e66939d8bfed8b18"}
Jul 20 23:07:51.212308 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:51.211989    2572 scope.go:117] "RemoveContainer" containerID="067aaf0e7eedf3b60e3db423fdfe4fd008ef2d62d3666e8f6e980b516ea99794"
Jul 20 23:07:51.227506 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:51.227480    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"]
Jul 20 23:07:51.231476 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:51.231453    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-bd5746-7d8bd8d9c8-mpgzz"]
Jul 20 23:07:53.168998 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:53.168966    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" path="/var/lib/kubelet/pods/0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e/volumes"
Jul 20 23:07:54.503494 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:54.503458    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:07:54.892022 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:07:54.891983    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:01.183804 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.183754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:01.282607 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.282575    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:01.437398 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.437303    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"]
Jul 20 23:08:01.437577 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.437551    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy" containerID="cri-o://b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744" gracePeriod=30
Jul 20 23:08:01.459787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.459759    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:01.691816 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.691724    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:01.809685 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.809650    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"]
Jul 20 23:08:01.809994 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.809981    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" containerName="maas-api"
Jul 20 23:08:01.810042 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.809996    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" containerName="maas-api"
Jul 20 23:08:01.810042 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.810008    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c6b441c-3455-468f-b382-878cad5c687e" containerName="main"
Jul 20 23:08:01.810042 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.810015    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c6b441c-3455-468f-b382-878cad5c687e" containerName="main"
Jul 20 23:08:01.810042 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.810034    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f0ce929-2bbd-4b79-aa5c-7c2089023dc2" containerName="test-curl-7410-140008228717600"
Jul 20 23:08:01.810042 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.810041    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f0ce929-2bbd-4b79-aa5c-7c2089023dc2" containerName="test-curl-7410-140008228717600"
Jul 20 23:08:01.810201 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.810095    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f0ce929-2bbd-4b79-aa5c-7c2089023dc2" containerName="test-curl-7410-140008228717600"
Jul 20 23:08:01.810201 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.810109    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d4038ba-bf57-4fd2-bc3f-ab9f33c5745e" containerName="maas-api"
Jul 20 23:08:01.810201 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.810116    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c6b441c-3455-468f-b382-878cad5c687e" containerName="main"
Jul 20 23:08:01.814605 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.814586    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"
Jul 20 23:08:01.817039 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.817018    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 23:08:01.819580 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.819555    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"]
Jul 20 23:08:01.970939 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:01.970834    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed135be-cb4c-47bf-8f14-5fb0d570a7f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n\" (UID: \"3ed135be-cb4c-47bf-8f14-5fb0d570a7f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"
Jul 20 23:08:02.071874 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:02.071816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed135be-cb4c-47bf-8f14-5fb0d570a7f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n\" (UID: \"3ed135be-cb4c-47bf-8f14-5fb0d570a7f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"
Jul 20 23:08:02.072513 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:02.072490    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed135be-cb4c-47bf-8f14-5fb0d570a7f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n\" (UID: \"3ed135be-cb4c-47bf-8f14-5fb0d570a7f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"
Jul 20 23:08:02.125939 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:02.125910    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"
Jul 20 23:08:02.269895 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:02.269815    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"]
Jul 20 23:08:02.273420 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:08:02.273392    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed135be_cb4c_47bf_8f14_5fb0d570a7f3.slice/crio-093b00722f343131fac0cc0c8608e2e2f6b28875d709755194bd02b69edfd3ae WatchSource:0}: Error finding container 093b00722f343131fac0cc0c8608e2e2f6b28875d709755194bd02b69edfd3ae: Status 404 returned error can't find the container with id 093b00722f343131fac0cc0c8608e2e2f6b28875d709755194bd02b69edfd3ae
Jul 20 23:08:02.354579 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:02.354542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:02.455494 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:02.455463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:03.264992 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:03.264880    2572 generic.go:356] "Generic (PLEG): container finished" podID="3ed135be-cb4c-47bf-8f14-5fb0d570a7f3" containerID="79745d5299a51665487f4ca7222ac2b7072787fea80d351f29910ed9fd3184fb" exitCode=0
Jul 20 23:08:03.264992 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:03.264930    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n" event={"ID":"3ed135be-cb4c-47bf-8f14-5fb0d570a7f3","Type":"ContainerDied","Data":"79745d5299a51665487f4ca7222ac2b7072787fea80d351f29910ed9fd3184fb"}
Jul 20 23:08:03.264992 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:03.264987    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n" event={"ID":"3ed135be-cb4c-47bf-8f14-5fb0d570a7f3","Type":"ContainerStarted","Data":"093b00722f343131fac0cc0c8608e2e2f6b28875d709755194bd02b69edfd3ae"}
Jul 20 23:08:04.392735 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:04.392688    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"
Jul 20 23:08:04.493292 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:04.493260    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed135be-cb4c-47bf-8f14-5fb0d570a7f3-maas-api-service-ca\") pod \"3ed135be-cb4c-47bf-8f14-5fb0d570a7f3\" (UID: \"3ed135be-cb4c-47bf-8f14-5fb0d570a7f3\") "
Jul 20 23:08:04.493653 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:04.493617    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed135be-cb4c-47bf-8f14-5fb0d570a7f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ed135be-cb4c-47bf-8f14-5fb0d570a7f3" (UID: "3ed135be-cb4c-47bf-8f14-5fb0d570a7f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:08:04.593805 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:04.593770    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed135be-cb4c-47bf-8f14-5fb0d570a7f3-maas-api-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:05.275335 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:05.275301    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"
Jul 20 23:08:05.275472 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:05.275276    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n" event={"ID":"3ed135be-cb4c-47bf-8f14-5fb0d570a7f3","Type":"ContainerDied","Data":"093b00722f343131fac0cc0c8608e2e2f6b28875d709755194bd02b69edfd3ae"}
Jul 20 23:08:05.275472 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:05.275423    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="093b00722f343131fac0cc0c8608e2e2f6b28875d709755194bd02b69edfd3ae"
Jul 20 23:08:06.669524 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.669500    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:08:06.707534 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707458    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-envoy\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.707534 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707494    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-data\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.707534 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707520    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb245274-f16f-424e-9441-a63fc3e23e57-istiod-ca-cert\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.707802 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707545    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-credential-socket\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.707802 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707570    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb245274-f16f-424e-9441-a63fc3e23e57-istio-podinfo\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.707802 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707624    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-socket\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.707802 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707723    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-istio-token\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.707802 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707748    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-certs\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.707802 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.707771    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clx8t\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-kube-api-access-clx8t\") pod \"cb245274-f16f-424e-9441-a63fc3e23e57\" (UID: \"cb245274-f16f-424e-9441-a63fc3e23e57\") "
Jul 20 23:08:06.708095 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.708050    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:08:06.708095 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.708071    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb245274-f16f-424e-9441-a63fc3e23e57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:08:06.708202 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.708091    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:08:06.708202 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.708150    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:08:06.708464 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.708443    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:08:06.709839 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.709810    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:08:06.710170 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.710141    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:08:06.710349 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.710333    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb245274-f16f-424e-9441-a63fc3e23e57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 20 23:08:06.710407 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.710338    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-kube-api-access-clx8t" (OuterVolumeSpecName: "kube-api-access-clx8t") pod "cb245274-f16f-424e-9441-a63fc3e23e57" (UID: "cb245274-f16f-424e-9441-a63fc3e23e57"). InnerVolumeSpecName "kube-api-access-clx8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:08:06.808856 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808820    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-istio-token\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:06.808856 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808850    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-certs\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:06.808856 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808864    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clx8t\" (UniqueName: \"kubernetes.io/projected/cb245274-f16f-424e-9441-a63fc3e23e57-kube-api-access-clx8t\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:06.809088 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808876    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-envoy\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:06.809088 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808889    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-istio-data\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:06.809088 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808899    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb245274-f16f-424e-9441-a63fc3e23e57-istiod-ca-cert\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:06.809088 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808909    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-credential-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:06.809088 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808920    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb245274-f16f-424e-9441-a63fc3e23e57-istio-podinfo\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:06.809088 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:06.808932    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb245274-f16f-424e-9441-a63fc3e23e57-workload-socket\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:07.284866 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.284831    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb245274-f16f-424e-9441-a63fc3e23e57" containerID="b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744" exitCode=0
Jul 20 23:08:07.285028 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.284887    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"
Jul 20 23:08:07.285028 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.284917    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" event={"ID":"cb245274-f16f-424e-9441-a63fc3e23e57","Type":"ContainerDied","Data":"b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744"}
Jul 20 23:08:07.285028 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.284975    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826" event={"ID":"cb245274-f16f-424e-9441-a63fc3e23e57","Type":"ContainerDied","Data":"3bd024f3eddc8964c4b2c01437fe42d1552eb42fb4d520a23318d6039afd5a49"}
Jul 20 23:08:07.285028 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.285005    2572 scope.go:117] "RemoveContainer" containerID="b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744"
Jul 20 23:08:07.293142 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.293121    2572 scope.go:117] "RemoveContainer" containerID="4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55"
Jul 20 23:08:07.300582 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.300565    2572 scope.go:117] "RemoveContainer" containerID="b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744"
Jul 20 23:08:07.300881 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:08:07.300855    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744\": container with ID starting with b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744 not found: ID does not exist" containerID="b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744"
Jul 20 23:08:07.300958 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.300895    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744"} err="failed to get container status \"b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744\": rpc error: code = NotFound desc = could not find container \"b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744\": container with ID starting with b134b4f420bd088958efd52ccc59b3d8efefdf442d4b418e419dfe7da20d0744 not found: ID does not exist"
Jul 20 23:08:07.300958 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.300918    2572 scope.go:117] "RemoveContainer" containerID="4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55"
Jul 20 23:08:07.301347 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:08:07.301295    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55\": container with ID starting with 4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55 not found: ID does not exist" containerID="4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55"
Jul 20 23:08:07.301497 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.301357    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55"} err="failed to get container status \"4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55\": rpc error: code = NotFound desc = could not find container \"4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55\": container with ID starting with 4b4ec4018609fd00042995eb6afc6dbdd506016993d53e06bb55e41113d3da55 not found: ID does not exist"
Jul 20 23:08:07.302872 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.302854    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"]
Jul 20 23:08:07.306277 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:07.306258    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-bd5746-openshift-default-bc59998f9-np826"]
Jul 20 23:08:09.168787 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:09.168752    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" path="/var/lib/kubelet/pods/cb245274-f16f-424e-9441-a63fc3e23e57/volumes"
Jul 20 23:08:12.237167 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.237134    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"]
Jul 20 23:08:12.237639 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.237372    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk" podUID="d21c915a-41cb-4b5d-b936-4bf940f1c5ea" containerName="maas-api" containerID="cri-o://5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655" gracePeriod=30
Jul 20 23:08:12.263057 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.262446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:12.472906 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.472882    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:08:12.547097 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.547011    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-maas-api-tls\") pod \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") "
Jul 20 23:08:12.547097 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.547049    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcmkt\" (UniqueName: \"kubernetes.io/projected/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-kube-api-access-wcmkt\") pod \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") "
Jul 20 23:08:12.547274 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.547114    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-openshift-service-ca\") pod \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\" (UID: \"d21c915a-41cb-4b5d-b936-4bf940f1c5ea\") "
Jul 20 23:08:12.547507 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.547472    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d21c915a-41cb-4b5d-b936-4bf940f1c5ea" (UID: "d21c915a-41cb-4b5d-b936-4bf940f1c5ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:08:12.549130 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.549107    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-kube-api-access-wcmkt" (OuterVolumeSpecName: "kube-api-access-wcmkt") pod "d21c915a-41cb-4b5d-b936-4bf940f1c5ea" (UID: "d21c915a-41cb-4b5d-b936-4bf940f1c5ea"). InnerVolumeSpecName "kube-api-access-wcmkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:08:12.549230 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.549115    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d21c915a-41cb-4b5d-b936-4bf940f1c5ea" (UID: "d21c915a-41cb-4b5d-b936-4bf940f1c5ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:08:12.648092 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.648054    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-openshift-service-ca\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:12.648092 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.648086    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-maas-api-tls\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:12.648092 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:12.648094    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcmkt\" (UniqueName: \"kubernetes.io/projected/d21c915a-41cb-4b5d-b936-4bf940f1c5ea-kube-api-access-wcmkt\") on node \"ip-10-0-136-15.ec2.internal\" DevicePath \"\""
Jul 20 23:08:13.310858 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.310818    2572 generic.go:356] "Generic (PLEG): container finished" podID="d21c915a-41cb-4b5d-b936-4bf940f1c5ea" containerID="5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655" exitCode=0
Jul 20 23:08:13.311257 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.310863    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"
Jul 20 23:08:13.311257 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.310869    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk" event={"ID":"d21c915a-41cb-4b5d-b936-4bf940f1c5ea","Type":"ContainerDied","Data":"5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655"}
Jul 20 23:08:13.311257 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.310926    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk" event={"ID":"d21c915a-41cb-4b5d-b936-4bf940f1c5ea","Type":"ContainerDied","Data":"4adc6b083fdc40e47443379fe8805eeea4b762b6d1503909e3d9d0ef345b62e5"}
Jul 20 23:08:13.311257 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.310949    2572 scope.go:117] "RemoveContainer" containerID="5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655"
Jul 20 23:08:13.318704 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.318674    2572 scope.go:117] "RemoveContainer" containerID="5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655"
Jul 20 23:08:13.318984 ip-10-0-136-15 kubenswrapper[2572]: E0720 23:08:13.318963    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655\": container with ID starting with 5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655 not found: ID does not exist" containerID="5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655"
Jul 20 23:08:13.319026 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.318990    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655"} err="failed to get container status \"5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655\": rpc error: code = NotFound desc = could not find container \"5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655\": container with ID starting with 5343124c0cbe9a817457eb935a8c25a2abc01b5a2bd8a7cb364af64179c9c655 not found: ID does not exist"
Jul 20 23:08:13.326937 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.326914    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"]
Jul 20 23:08:13.330713 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:13.330680    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-4a9ead-675ff9d9c7-h5fvk"]
Jul 20 23:08:15.169175 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:15.169140    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d21c915a-41cb-4b5d-b936-4bf940f1c5ea" path="/var/lib/kubelet/pods/d21c915a-41cb-4b5d-b936-4bf940f1c5ea/volumes"
Jul 20 23:08:16.885464 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:16.885427    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"]
Jul 20 23:08:16.886309 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:16.886277    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:16.887310 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:16.887292    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-4a9ead-24b4n"]
Jul 20 23:08:17.168009 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:17.167897    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ed135be-cb4c-47bf-8f14-5fb0d570a7f3" path="/var/lib/kubelet/pods/3ed135be-cb4c-47bf-8f14-5fb0d570a7f3/volumes"
Jul 20 23:08:17.287552 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:17.287511    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:23.441759 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:23.441722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:23.523046 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:23.523012    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:23.793454 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:23.793357    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:23.853878 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:23.853844    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:23.957625 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:23.957587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:30.645811 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:30.645781    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795f5f468-h6rs9_d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58/copy-manifests/0.log"
Jul 20 23:08:30.655245 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:30.655216    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795f5f468-h6rs9_d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58/manager/0.log"
Jul 20 23:08:31.118685 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:31.118658    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743125-rtwhx_476c74e5-ba73-4eda-802a-4bdab93539ac/cleanup/0.log"
Jul 20 23:08:33.270399 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:33.270364    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qdtbl_c291deb2-d074-419d-8835-60eb26b46f19/manager/0.log"
Jul 20 23:08:34.098498 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:34.098470    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5957d7d59-b9gkc_d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb/kube-auth-proxy/0.log"
Jul 20 23:08:35.144955 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:35.144930    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-k25dl_93328ee8-de5a-4fbe-94bb-64d321d4396c/main/0.log"
Jul 20 23:08:35.610064 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:35.610029    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-r9zxb_ee9b5ddf-069a-450e-b868-0da954b09b59/main/0.log"
Jul 20 23:08:40.965005 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.964966    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fl6rb/must-gather-8gshq"]
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965252    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d21c915a-41cb-4b5d-b936-4bf940f1c5ea" containerName="maas-api"
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965262    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21c915a-41cb-4b5d-b936-4bf940f1c5ea" containerName="maas-api"
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965277    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy"
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965283    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy"
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965294    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed135be-cb4c-47bf-8f14-5fb0d570a7f3" containerName="revoke-keys"
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965301    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed135be-cb4c-47bf-8f14-5fb0d570a7f3" containerName="revoke-keys"
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965344    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy"
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965351    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d21c915a-41cb-4b5d-b936-4bf940f1c5ea" containerName="maas-api"
Jul 20 23:08:40.965378 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965357    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed135be-cb4c-47bf-8f14-5fb0d570a7f3" containerName="revoke-keys"
Jul 20 23:08:40.965645 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965400    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy"
Jul 20 23:08:40.965645 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965405    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy"
Jul 20 23:08:40.965645 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.965453    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb245274-f16f-424e-9441-a63fc3e23e57" containerName="istio-proxy"
Jul 20 23:08:40.968239 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.968222    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6rb/must-gather-8gshq"
Jul 20 23:08:40.970707 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.970671    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6rb\"/\"kube-root-ca.crt\""
Jul 20 23:08:40.971623 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.971608    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fl6rb\"/\"default-dockercfg-q7vsn\""
Jul 20 23:08:40.971730 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.971612    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6rb\"/\"openshift-service-ca.crt\""
Jul 20 23:08:40.977215 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.977190    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6rb/must-gather-8gshq"]
Jul 20 23:08:40.989130 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:40.989101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:41.089770 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.089729    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7de7c50a-3683-4894-96e4-a59007f2ab10-must-gather-output\") pod \"must-gather-8gshq\" (UID: \"7de7c50a-3683-4894-96e4-a59007f2ab10\") " pod="openshift-must-gather-fl6rb/must-gather-8gshq"
Jul 20 23:08:41.089986 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.089839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvcjz\" (UniqueName: \"kubernetes.io/projected/7de7c50a-3683-4894-96e4-a59007f2ab10-kube-api-access-mvcjz\") pod \"must-gather-8gshq\" (UID: \"7de7c50a-3683-4894-96e4-a59007f2ab10\") " pod="openshift-must-gather-fl6rb/must-gather-8gshq"
Jul 20 23:08:41.090394 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.090370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:41.190373 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.190333    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7de7c50a-3683-4894-96e4-a59007f2ab10-must-gather-output\") pod \"must-gather-8gshq\" (UID: \"7de7c50a-3683-4894-96e4-a59007f2ab10\") " pod="openshift-must-gather-fl6rb/must-gather-8gshq"
Jul 20 23:08:41.190540 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.190413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvcjz\" (UniqueName: \"kubernetes.io/projected/7de7c50a-3683-4894-96e4-a59007f2ab10-kube-api-access-mvcjz\") pod \"must-gather-8gshq\" (UID: \"7de7c50a-3683-4894-96e4-a59007f2ab10\") " pod="openshift-must-gather-fl6rb/must-gather-8gshq"
Jul 20 23:08:41.190688 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.190669    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7de7c50a-3683-4894-96e4-a59007f2ab10-must-gather-output\") pod \"must-gather-8gshq\" (UID: \"7de7c50a-3683-4894-96e4-a59007f2ab10\") " pod="openshift-must-gather-fl6rb/must-gather-8gshq"
Jul 20 23:08:41.198811 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.198787    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvcjz\" (UniqueName: \"kubernetes.io/projected/7de7c50a-3683-4894-96e4-a59007f2ab10-kube-api-access-mvcjz\") pod \"must-gather-8gshq\" (UID: \"7de7c50a-3683-4894-96e4-a59007f2ab10\") " pod="openshift-must-gather-fl6rb/must-gather-8gshq"
Jul 20 23:08:41.278336 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.278252    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6rb/must-gather-8gshq"
Jul 20 23:08:41.422360 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:41.422332    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6rb/must-gather-8gshq"]
Jul 20 23:08:41.424150 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:08:41.424123    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7de7c50a_3683_4894_96e4_a59007f2ab10.slice/crio-56a196051f304f605b59319d5b3bd712228313a0c70034a621431eaf2c3317a6 WatchSource:0}: Error finding container 56a196051f304f605b59319d5b3bd712228313a0c70034a621431eaf2c3317a6: Status 404 returned error can't find the container with id 56a196051f304f605b59319d5b3bd712228313a0c70034a621431eaf2c3317a6
Jul 20 23:08:42.434453 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:42.434415    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6rb/must-gather-8gshq" event={"ID":"7de7c50a-3683-4894-96e4-a59007f2ab10","Type":"ContainerStarted","Data":"56a196051f304f605b59319d5b3bd712228313a0c70034a621431eaf2c3317a6"}
Jul 20 23:08:43.444140 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:43.443278    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6rb/must-gather-8gshq" event={"ID":"7de7c50a-3683-4894-96e4-a59007f2ab10","Type":"ContainerStarted","Data":"9adf091a0510c7e2828676298db345e807b5d3850c8f0aad3d2b81f054b79e8b"}
Jul 20 23:08:43.444140 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:43.443332    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6rb/must-gather-8gshq" event={"ID":"7de7c50a-3683-4894-96e4-a59007f2ab10","Type":"ContainerStarted","Data":"ff44d7bc72e03bdb4393f98b11f4f06ad49f7afe9e65a88766908266d7801568"}
Jul 20 23:08:43.461152 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:43.461088    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fl6rb/must-gather-8gshq" podStartSLOduration=2.378038127 podStartE2EDuration="3.461067944s" totalImagesPullingTime="1.083029817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:08:43.459900622 +0000 UTC m=+2744.851155818" watchObservedRunningTime="2026-07-20 23:08:43.461067944 +0000 UTC m=+2744.852323141"
Jul 20 23:08:44.075019 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:44.074983    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rhs8q_933fd8ef-d979-4fb3-a1ec-8b914e77aae4/global-pull-secret-syncer/0.log"
Jul 20 23:08:44.170582 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:44.170548    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log"
Jul 20 23:08:44.314009 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:44.313977    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-15.ec2.internal_004c5084a01cb59f72fdfadb659205a4/haproxy/0.log"
Jul 20 23:08:45.775128 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:45.775044    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4zbpd_67022b7a-0606-461d-8ddc-5b3582a485ad/konnectivity-agent/0.log" limit=1024
Jul 20 23:08:49.518002 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:49.517650    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qdtbl_c291deb2-d074-419d-8835-60eb26b46f19/manager/0.log"
Jul 20 23:08:51.526983 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.526952    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p6fcc_b23f5619-77da-4344-8adc-5207f23fa844/node-exporter/0.log"
Jul 20 23:08:51.556103 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.556071    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p6fcc_b23f5619-77da-4344-8adc-5207f23fa844/kube-rbac-proxy/0.log"
Jul 20 23:08:51.577945 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.577906    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p6fcc_b23f5619-77da-4344-8adc-5207f23fa844/init-textfile/0.log"
Jul 20 23:08:51.764437 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.764336    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11e66bb1-d515-49f7-9906-28de3b16c0d5/prometheus/0.log"
Jul 20 23:08:51.785744 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.785686    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11e66bb1-d515-49f7-9906-28de3b16c0d5/config-reloader/0.log"
Jul 20 23:08:51.813723 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.812449    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11e66bb1-d515-49f7-9906-28de3b16c0d5/thanos-sidecar/0.log"
Jul 20 23:08:51.838945 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.838918    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11e66bb1-d515-49f7-9906-28de3b16c0d5/kube-rbac-proxy-web/0.log"
Jul 20 23:08:51.864204 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.864177    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11e66bb1-d515-49f7-9906-28de3b16c0d5/kube-rbac-proxy/0.log"
Jul 20 23:08:51.887820 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.887788    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11e66bb1-d515-49f7-9906-28de3b16c0d5/kube-rbac-proxy-thanos/0.log"
Jul 20 23:08:51.914476 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:51.914446    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_11e66bb1-d515-49f7-9906-28de3b16c0d5/init-config-reloader/0.log"
Jul 20 23:08:54.130391 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.130354    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"]
Jul 20 23:08:54.136062 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.136032    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.143594 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.143562    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"]
Jul 20 23:08:54.317555 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.317515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-lib-modules\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.317759 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.317570    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-sys\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.317759 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.317618    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-podres\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.317883 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.317764    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-proc\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.317883 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.317824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d4t8\" (UniqueName: \"kubernetes.io/projected/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-kube-api-access-9d4t8\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418415 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418317    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-sys\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418415 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418371    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-podres\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418415 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-proc\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418730 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418434    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4t8\" (UniqueName: \"kubernetes.io/projected/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-kube-api-access-9d4t8\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418730 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418465    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-sys\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418730 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418469    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-lib-modules\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418730 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418571    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-lib-modules\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418730 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418588    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-proc\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.418730 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.418680    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-podres\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.426409 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.426335    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d4t8\" (UniqueName: \"kubernetes.io/projected/68cc648a-f2e6-47ce-9780-c2fbe1b016ce-kube-api-access-9d4t8\") pod \"perf-node-gather-daemonset-sl874\" (UID: \"68cc648a-f2e6-47ce-9780-c2fbe1b016ce\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.452208 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.452174    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:54.633408 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:54.633309    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"]
Jul 20 23:08:54.641445 ip-10-0-136-15 kubenswrapper[2572]: W0720 23:08:54.641399    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod68cc648a_f2e6_47ce_9780_c2fbe1b016ce.slice/crio-2a8c6b3623d2f08e77cf96ba9a3da68fc947bc1e552ae5331f4efec466658240 WatchSource:0}: Error finding container 2a8c6b3623d2f08e77cf96ba9a3da68fc947bc1e552ae5331f4efec466658240: Status 404 returned error can't find the container with id 2a8c6b3623d2f08e77cf96ba9a3da68fc947bc1e552ae5331f4efec466658240
Jul 20 23:08:55.521178 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:55.521129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874" event={"ID":"68cc648a-f2e6-47ce-9780-c2fbe1b016ce","Type":"ContainerStarted","Data":"cb360a27eccdda6dc8c982990586089445f3b4325790fa1000a7a5e804e96e14"}
Jul 20 23:08:55.521646 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:55.521212    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874" event={"ID":"68cc648a-f2e6-47ce-9780-c2fbe1b016ce","Type":"ContainerStarted","Data":"2a8c6b3623d2f08e77cf96ba9a3da68fc947bc1e552ae5331f4efec466658240"}
Jul 20 23:08:55.521646 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:55.521244    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:08:55.538058 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:55.538008    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874" podStartSLOduration=1.5379929890000001 podStartE2EDuration="1.537992989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 23:08:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:08:55.53620322 +0000 UTC m=+2756.927458417" watchObservedRunningTime="2026-07-20 23:08:55.537992989 +0000 UTC m=+2756.929248230"
Jul 20 23:08:56.428744 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:56.428712    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r9tzs_6a7cd14e-70d1-444e-a33a-c78bceda7799/dns/0.log"
Jul 20 23:08:56.447268 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:56.447239    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r9tzs_6a7cd14e-70d1-444e-a33a-c78bceda7799/kube-rbac-proxy/0.log"
Jul 20 23:08:56.514506 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:56.514478    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4trw_becf7578-ba19-449d-a011-59cc584d9f17/dns-node-resolver/0.log"
Jul 20 23:08:57.051300 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:57.051264    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f9qht_02c95ba1-0943-4f5f-83d8-37112fa3dd4e/node-ca/0.log"
Jul 20 23:08:58.157138 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:58.157105    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5957d7d59-b9gkc_d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb/kube-auth-proxy/0.log"
Jul 20 23:08:59.051764 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:59.051729    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pvpdm_fae22371-021b-4515-a7f1-ed314a9c5558/serve-healthcheck-canary/0.log"
Jul 20 23:08:59.689164 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:59.689091    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pjwz6_ec578931-06be-4194-abef-b6adaf903b2c/kube-rbac-proxy/0.log"
Jul 20 23:08:59.707820 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:59.707788    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pjwz6_ec578931-06be-4194-abef-b6adaf903b2c/exporter/0.log"
Jul 20 23:08:59.728767 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:08:59.728739    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pjwz6_ec578931-06be-4194-abef-b6adaf903b2c/extractor/0.log"
Jul 20 23:09:01.537200 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:01.537168    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-sl874"
Jul 20 23:09:02.371925 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:02.371885    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795f5f468-h6rs9_d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58/manager/0.log"
Jul 20 23:09:02.392261 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:02.392228    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795f5f468-h6rs9_d7ca00b7-2cf7-4a5d-81a0-fd8e2d11ba58/copy-manifests/0.log"
Jul 20 23:09:03.778988 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:03.778900    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-cb4c45cc6-n6nhz_10ae8361-94bb-45d4-ac10-6fda4b4f7ac9/manager/0.log"
Jul 20 23:09:04.609414 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:04.609378    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5957d7d59-b9gkc_d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb/kube-auth-proxy/0.log"
Jul 20 23:09:06.136011 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:06.135982    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5957d7d59-b9gkc_d100fcbd-e55f-4ff4-b53b-7de2dfaf40cb/kube-auth-proxy/0.log"
Jul 20 23:09:08.800962 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:08.800922    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-mmpd9_e68cbda9-fbc3-4c1f-895e-0abbf183b6d1/migrator/0.log"
Jul 20 23:09:08.822660 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:08.822633    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-mmpd9_e68cbda9-fbc3-4c1f-895e-0abbf183b6d1/graceful-termination/0.log"
Jul 20 23:09:10.372390 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.372364    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlq8_504a25f5-9b0c-4111-b516-0c1345759490/kube-multus-additional-cni-plugins/0.log"
Jul 20 23:09:10.392665 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.392639    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlq8_504a25f5-9b0c-4111-b516-0c1345759490/egress-router-binary-copy/0.log"
Jul 20 23:09:10.412504 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.412475    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlq8_504a25f5-9b0c-4111-b516-0c1345759490/cni-plugins/0.log"
Jul 20 23:09:10.433566 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.433536    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlq8_504a25f5-9b0c-4111-b516-0c1345759490/bond-cni-plugin/0.log"
Jul 20 23:09:10.454226 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.454190    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlq8_504a25f5-9b0c-4111-b516-0c1345759490/routeoverride-cni/0.log"
Jul 20 23:09:10.473483 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.473460    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlq8_504a25f5-9b0c-4111-b516-0c1345759490/whereabouts-cni-bincopy/0.log"
Jul 20 23:09:10.494674 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.494644    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4xlq8_504a25f5-9b0c-4111-b516-0c1345759490/whereabouts-cni/0.log"
Jul 20 23:09:10.711227 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.711144    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fkvmr_53f220b7-02ac-4a9a-b3b7-073cf6ac27a7/kube-multus/0.log"
Jul 20 23:09:10.763124 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.763097    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b7hjs_6d7b2314-23d4-4538-973f-ec96e28a1b7f/network-metrics-daemon/0.log"
Jul 20 23:09:10.779811 ip-10-0-136-15 kubenswrapper[2572]: I0720 23:09:10.779781    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b7hjs_6d7b2314-23d4-4538-973f-ec96e28a1b7f/kube-rbac-proxy/0.log"