Jul 17 10:52:39.077360 ip-10-0-131-178 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 10:52:39.493090 ip-10-0-131-178 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:52:39.493090 ip-10-0-131-178 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 10:52:39.493090 ip-10-0-131-178 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:52:39.493090 ip-10-0-131-178 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 10:52:39.493090 ip-10-0-131-178 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 10:52:39.494910 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.494829    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 10:52:39.499720 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499704    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:39.499720 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499721    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499725    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499729    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499732    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499737    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499741    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499744    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499747    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499751    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499755    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499758    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499761    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499764    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499768    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499771    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499774    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499776    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499779    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499782    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:39.499823 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499784    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499792    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499794    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499797    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499799    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499802    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499805    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499807    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499810    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499812    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499815    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499817    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499820    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499822    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499826    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499828    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499831    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499834    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499837    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499839    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:39.500291 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499842    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499844    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499847    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499849    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499852    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499854    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499856    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499859    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499861    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499864    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499866    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499869    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499871    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499874    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499878    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499880    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499883    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499885    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499888    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499890    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:39.500772 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499892    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499895    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499897    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499900    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499903    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499905    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499908    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499911    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499913    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499916    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499919    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499921    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499924    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499927    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499929    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499932    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499936    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499938    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499941    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499943    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:39.501391 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499946    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499948    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499951    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499953    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499956    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499959    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499961    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499964    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499967    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499969    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499972    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499974    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499977    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499979    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499982    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499984    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499986    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499989    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.499991    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500691    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:39.501966 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500699    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500702    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500706    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500708    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500711    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500714    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500717    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500720    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500722    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500725    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500727    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500730    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500732    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500735    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500737    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500740    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500743    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500745    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500749    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:39.502748 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500751    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500755    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500757    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500760    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500763    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500766    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500769    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500771    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500774    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500777    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500780    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500784    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500789    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500792    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500796    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500801    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500804    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500807    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500810    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:39.503360 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500813    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500816    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500818    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500821    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500823    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500826    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500828    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500831    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500833    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500836    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500838    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500841    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500844    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500848    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500850    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500854    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500856    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500859    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500861    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500864    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:39.503825 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500866    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500869    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500871    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500874    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500876    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500879    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500881    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500884    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500886    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500889    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500891    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500893    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500896    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500898    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500901    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500904    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500906    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500909    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500912    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500914    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:39.504338 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500917    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500920    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500922    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500924    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500927    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500929    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500931    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500934    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500937    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500940    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500942    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500945    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500947    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500949    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500952    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500954    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500957    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500959    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500962    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.500965    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:39.504827 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501685    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501708    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501717    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501730    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501738    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501746    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501754    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501761    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501768    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501776    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501784    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501792    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501799    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501811    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501819    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501825    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501832    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501838    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501846    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501853    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:39.505326 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501863    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501872    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501880    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501887    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501894    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501900    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501912    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501917    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501922    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501926    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501932    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501936    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501941    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501946    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501950    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501958    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501962    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501968    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501978    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501982    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:39.505812 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.501987    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502002    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502006    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502011    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502016    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502020    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502032    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502037    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502041    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502046    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502055    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502059    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502064    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502069    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502086    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502091    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502096    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502100    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502105    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502109    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:39.506323 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502114    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502118    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502122    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502132    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502137    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502141    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502146    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502156    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502162    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502167    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502171    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502176    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502181    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502186    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502195    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502200    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502204    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502208    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502212    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:39.506807 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502216    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502221    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502227    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502233    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502238    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502243    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502247    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502257    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502262    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502266    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502270    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502274    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502278    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502283    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502287    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502291    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502295    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502299    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502304    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:39.507289 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.502309    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502458    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502469    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502480    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502487    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502494    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502504    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502512    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502518    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502524    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502529    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502534    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502539    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502544    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502554    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502559    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502564    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502569    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502574    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502580    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502584    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502591    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502601    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502607    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 10:52:39.507742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502613    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502618    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502623    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502629    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502634    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502639    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502644    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502654    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502659    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502668    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502673    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502677    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502682    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502687    2562 flags.go:64] FLAG: --enable-server="true"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502692    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502705    2562 flags.go:64] FLAG: --event-burst="100"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502710    2562 flags.go:64] FLAG: --event-qps="50"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502715    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502720    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502725    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502731    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502736    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502741    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502747    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502757    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 10:52:39.508367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502763    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502768    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502773    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502778    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502783    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502789    2562 flags.go:64] FLAG: --feature-gates=""
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502795    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502805    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502811    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502816    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502821    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502826    2562 flags.go:64] FLAG: --help="false"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502831    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502836    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502841    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502851    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502857    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502863    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502867    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502872    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502877    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502883    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502888    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502893    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 10:52:39.508963 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502902    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502920    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502958    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502966    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502972    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502979    2562 flags.go:64] FLAG: --lock-file=""
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502984    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.502987    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503145    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503156    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503160    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503164    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503167    2562 flags.go:64] FLAG: --logging-format="text"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503171    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503175    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503178    2562 flags.go:64] FLAG: --manifest-url=""
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503182    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503187    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503191    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503195    2562 flags.go:64] FLAG: --max-pods="110"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503199    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503203    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503207    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503210    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503213    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 10:52:39.509570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503216    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503219    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503240    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503244    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503247    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503250    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503253    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503259    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503262    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503265    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503267    2562 flags.go:64] FLAG: --port="10250"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503271    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503274    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-092121ad0d82d7b3f"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503277    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503280    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503286    2562 flags.go:64] FLAG: --register-node="true"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503289    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503293    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503296    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503299    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503302    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503306    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503309    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503312    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503315    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 10:52:39.510222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503317    2562 flags.go:64] FLAG: --runonce="false"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503320    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503324    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503327    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503330    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503333    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503336    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503339    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503342    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503345    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503348    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503351    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503354    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503357    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503360    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503363    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503370    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503373    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503376    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503382    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503385    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503388    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503393    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503396    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503399    2562 flags.go:64] FLAG: --v="2"
Jul 17 10:52:39.510817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503403    2562 flags.go:64] FLAG: --version="false"
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503407    2562 flags.go:64] FLAG: --vmodule=""
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503410    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.503414    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503527    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503531    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503534    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503537    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503540    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503543    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503546    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503548    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503551    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503553    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503556    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503559    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503563    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503566    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503569    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503571    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:39.511435 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503574    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503577    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503580    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503582    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503585    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503587    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503590    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503592    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503595    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503599    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503602    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503605    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503608    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503611    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503613    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503617    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503619    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503622    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503626    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503629    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:39.511955 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503633    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503636    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503639    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503642    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503644    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503647    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503650    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503653    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503655    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503659    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503662    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503665    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503668    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503671    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503674    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503677    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503679    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503682    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503684    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:39.512460 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503687    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503690    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503694    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503697    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503700    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503702    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503705    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503707    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503710    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503714    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503716    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503719    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503721    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503724    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503727    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503729    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503732    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503734    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503737    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503739    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:39.512927 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503742    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503744    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503747    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503750    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503752    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503755    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503757    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503760    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503763    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503765    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503768    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503770    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503773    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503777    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503781    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503784    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503787    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503789    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503792    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503794    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:39.513443 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503797    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503799    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503802    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.503805    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.504766    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.511288    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.511304    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.511321    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.511326    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511380    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511386    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511390    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511394    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511396    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:39.513932 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511399    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511402    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511404    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511407    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511410    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511412    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511415    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511418    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511421    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511424    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511426    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511429    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511431    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511434    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511437    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511440    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511442    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511445    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511448    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511451    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:39.514307 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511454    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511456    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511459    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511461    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511466    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511469    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511471    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511474    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511476    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511479    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511481    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511484    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511486    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511489    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511492    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511494    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511497    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511499    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511501    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511504    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:39.514797 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511506    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511509    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511511    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511514    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511516    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511519    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511521    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511524    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511528    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511531    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511535    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511538    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511541    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511544    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511547    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511550    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511553    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511557    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511560    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:39.515357 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511563    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511565    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511569    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511573    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511575    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511578    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511581    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511583    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511586    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511588    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511591    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511594    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511596    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511599    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511601    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511604    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511606    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511609    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511611    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:39.515821 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511614    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511616    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511619    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511621    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511624    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511627    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511629    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511632    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511634    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511636    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511639    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511642    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511645    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511648    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511650    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:39.516294 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511653    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.511658    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511762    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511766    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511769    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511772    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511775    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511777    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511780    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511783    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511785    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511788    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511790    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511793    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511796    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 10:52:39.516662 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511798    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511801    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511805    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511808    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511812    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511814    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511817    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511819    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511822    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511824    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511827    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511830    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511833    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511835    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511838    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511841    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511844    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511846    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511849    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511852    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 10:52:39.517019 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511854    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511856    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511859    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511861    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511864    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511866    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511869    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511872    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511874    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511877    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511879    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511882    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511884    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511887    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511889    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511892    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511895    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511897    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511900    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 10:52:39.517509 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511902    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511905    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511907    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511910    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511912    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511915    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511918    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511920    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511923    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511926    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511929    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511931    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511933    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511936    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511939    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511941    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511944    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511946    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511949    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511951    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 10:52:39.517958 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511953    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511956    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511959    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511962    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511964    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511967    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511970    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511973    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511976    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511978    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511981    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511984    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511986    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511988    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511991    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511993    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511996    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.511998    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512002    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 10:52:39.518472 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512005    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512008    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512011    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512014    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512017    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512021    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512024    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:39.512027    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.512032    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.512163    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.514310    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.515637    2562 server.go:1019] "Starting client certificate rotation"
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.515739    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 10:52:39.518936 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.515774    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 10:52:39.519294 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.519105    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 10:52:39.523849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.523827    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 10:52:39.532714 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.532695    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 17 10:52:39.535872 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.535851    2562 log.go:25] "Validated CRI v1 image API"
Jul 17 10:52:39.536673 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.536653    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 10:52:39.540667 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.540647    2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8784a95a-a479-4e1f-8424-fece6c765096:/dev/nvme0n1p4 d764a0d1-d432-4749-9398-87d8bdab1db0:/dev/nvme0n1p3]
Jul 17 10:52:39.540765 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.540665    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 10:52:39.544354 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.544336    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 10:52:39.546688 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.546582    2562 manager.go:216] Machine: {Timestamp:2026-07-17 10:52:39.545160952 +0000 UTC m=+0.350186433 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3161123 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a43f3287240c782f9e25ed242f16d SystemUUID:ec2a43f3-2872-40c7-82f9-e25ed242f16d BootID:0352e856-9d42-4c48-8c70-a15f69488e18 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c2:ff:76:e1:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c2:ff:76:e1:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:26:00:40:bd:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 10:52:39.546688 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.546682    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 10:52:39.546798 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.546762    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 10:52:39.550113 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.550091    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 10:52:39.550270 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.550117    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 10:52:39.550889 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.550879    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 10:52:39.550922 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.550892    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 10:52:39.550922 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.550899    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 10:52:39.551670 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.551660    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 10:52:39.552746 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.552736    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 10:52:39.555282 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555271    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 10:52:39.555400 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555388    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 10:52:39.555434 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555421    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 10:52:39.555434 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555433    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 10:52:39.555491 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555443    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 10:52:39.555491 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555454    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 17 10:52:39.555491 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555463    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 10:52:39.555805 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555795    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 10:52:39.555855 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.555814    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 10:52:39.558403 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.558378    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 10:52:39.560013 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.559999    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 10:52:39.560070 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.560030    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 10:52:39.560990 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.560979    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 10:52:39.561025 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.560996    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 10:52:39.561025 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561003    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 10:52:39.561025 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561009    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 10:52:39.561025 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561017    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 10:52:39.561025 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561023    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 10:52:39.561178 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561038    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 10:52:39.561178 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561043    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 10:52:39.561178 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561051    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 10:52:39.561178 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561058    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 10:52:39.561178 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561090    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 10:52:39.561178 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.561098    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 10:52:39.562445 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.562434    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 10:52:39.562445 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.562445    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 10:52:39.565234 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.565217    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 10:52:39.565693 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.565681    2562 server.go:1268] "Started kubelet"
Jul 17 10:52:39.565803 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.565776    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 10:52:39.565897 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.565777    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 10:52:39.565897 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.565818    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 10:52:39.566057 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.565812    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 10:52:39.566057 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.565982    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 10:52:39.566701 ip-10-0-131-178 systemd[1]: Started Kubernetes Kubelet.
Jul 17 10:52:39.568199 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.568187    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 10:52:39.570053 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.570034    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 10:52:39.571437 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.571421    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 10:52:39.575149 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.574231    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-178.ec2.internal.18c30e434bc51e29  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-178.ec2.internal,UID:ip-10-0-131-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-178.ec2.internal,},FirstTimestamp:2026-07-17 10:52:39.565655593 +0000 UTC m=+0.370681069,LastTimestamp:2026-07-17 10:52:39.565655593 +0000 UTC m=+0.370681069,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-178.ec2.internal,}"
Jul 17 10:52:39.575224 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.575215    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 10:52:39.575269 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.575218    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 10:52:39.575349 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.575336    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:39.575972 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.575940    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 10:52:39.576203 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.576019    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 10:52:39.576203 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.576203    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 10:52:39.576324 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.576292    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 10:52:39.576324 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.576305    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 10:52:39.577177 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.577161    2562 factory.go:55] Registering systemd factory
Jul 17 10:52:39.577303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.577293    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 17 10:52:39.577626 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.577609    2562 factory.go:153] Registering CRI-O factory
Jul 17 10:52:39.577701 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.577630    2562 factory.go:223] Registration of the crio container factory successfully
Jul 17 10:52:39.577750 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.577701    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 10:52:39.577750 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.577726    2562 factory.go:103] Registering Raw factory
Jul 17 10:52:39.577750 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.577742    2562 manager.go:1196] Started watching for new ooms in manager
Jul 17 10:52:39.577933 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.577910    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gt7gt"
Jul 17 10:52:39.578205 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.578188    2562 manager.go:349] Starting recovery of all containers
Jul 17 10:52:39.580908 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.580883    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 10:52:39.580908 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.580895    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 10:52:39.586229 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.586207    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gt7gt"
Jul 17 10:52:39.590887 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.590713    2562 manager.go:354] Recovery completed
Jul 17 10:52:39.595769 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.595750    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:39.597468 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.597451    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:39.597553 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.597486    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:39.597553 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.597502    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:39.598047 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.598032    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 10:52:39.598047 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.598047    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 10:52:39.598207 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.598055    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:39.598207 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.598064    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 10:52:39.598833 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.598808    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:39.598905 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.598838    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:39.598905 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.598852    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:39.599098 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.599071    2562 policy_none.go:49] "None policy: Start"
Jul 17 10:52:39.599140 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.599103    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 10:52:39.599140 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.599114    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 10:52:39.599561 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.599485    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-178.ec2.internal.18c30e434daa901a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-178.ec2.internal,UID:ip-10-0-131-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-178.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-178.ec2.internal,},FirstTimestamp:2026-07-17 10:52:39.597469722 +0000 UTC m=+0.402495205,LastTimestamp:2026-07-17 10:52:39.597469722 +0000 UTC m=+0.402495205,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-178.ec2.internal,}"
Jul 17 10:52:39.600147 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.600136    2562 policy_none.go:47] "Start"
Jul 17 10:52:39.649648 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.649629    2562 manager.go:337] "Starting Device Plugin manager"
Jul 17 10:52:39.649728 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.649661    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 10:52:39.649728 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.649674    2562 server.go:87] "Starting device plugin registration server"
Jul 17 10:52:39.649957 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.649945    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 10:52:39.649994 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.649960    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 10:52:39.650234 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.650206    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 10:52:39.650353 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.650296    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 10:52:39.650353 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.650304    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 10:52:39.650757 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.650734    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 10:52:39.650824 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.650793    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:39.672695 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.672673    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 10:52:39.673851 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.673831    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 10:52:39.673931 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.673874    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 10:52:39.673931 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.673899    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 10:52:39.674034 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.673934    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 10:52:39.676295 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.676277    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:39.751301 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.751222    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:39.752207 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.752192    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:39.752278 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.752221    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:39.752278 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.752232    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:39.752278 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.752254    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.761122 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.761106    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.761163 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.761133    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-178.ec2.internal\": node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:39.774478 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.774457    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal"]
Jul 17 10:52:39.774560 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.774512    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:39.775289 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.775266    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:39.775289 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.775291    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:39.775416 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.775302    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:39.775784 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.775760    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:39.776568 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.776556    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:39.777143 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.776895    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.777143 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.776961    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:39.777922 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.777905    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:39.778053 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.777932    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:39.778053 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.777981    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:39.779336 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.779315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.779419 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.779347    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 10:52:39.779468 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.779437    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:39.779511 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.779463    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:39.779544 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.779515    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:39.779934 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.779918    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 10:52:39.780024 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.779948    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 10:52:39.780024 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.779962    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeHasSufficientPID"
Jul 17 10:52:39.806786 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.806763    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-178.ec2.internal\" not found" node="ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.811270 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.811253    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-178.ec2.internal\" not found" node="ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.876576 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.876549    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:39.876702 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.876629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b28eb33973c48f7bdbf2d52730496ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal\" (UID: \"b28eb33973c48f7bdbf2d52730496ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.876702 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.876647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28eb33973c48f7bdbf2d52730496ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal\" (UID: \"b28eb33973c48f7bdbf2d52730496ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.876702 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.876665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc6d4e274b58fd0b6a9631751aad296-config\") pod \"kube-apiserver-proxy-ip-10-0-131-178.ec2.internal\" (UID: \"acc6d4e274b58fd0b6a9631751aad296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.977010 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:39.976979    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:39.977118 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.977013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b28eb33973c48f7bdbf2d52730496ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal\" (UID: \"b28eb33973c48f7bdbf2d52730496ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.977118 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.977037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28eb33973c48f7bdbf2d52730496ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal\" (UID: \"b28eb33973c48f7bdbf2d52730496ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.977118 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.977056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc6d4e274b58fd0b6a9631751aad296-config\") pod \"kube-apiserver-proxy-ip-10-0-131-178.ec2.internal\" (UID: \"acc6d4e274b58fd0b6a9631751aad296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.977234 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.977124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28eb33973c48f7bdbf2d52730496ba9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal\" (UID: \"b28eb33973c48f7bdbf2d52730496ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.977234 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.977124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/acc6d4e274b58fd0b6a9631751aad296-config\") pod \"kube-apiserver-proxy-ip-10-0-131-178.ec2.internal\" (UID: \"acc6d4e274b58fd0b6a9631751aad296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:39.977234 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:39.977125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b28eb33973c48f7bdbf2d52730496ba9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal\" (UID: \"b28eb33973c48f7bdbf2d52730496ba9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:40.077523 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.077465    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.110613 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.110589    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:40.114729 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.114713    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:40.178053 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.178017    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.278377 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.278354    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.378776 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.378748    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.479171 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.479141    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.515341 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.515320    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 10:52:40.515797 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.515448    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 10:52:40.579700 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.579676    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.590141 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.590111    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 10:47:39 +0000 UTC" deadline="2028-03-28 13:58:16.051375754 +0000 UTC"
Jul 17 10:52:40.590141 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.590139    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14883h5m35.461241374s"
Jul 17 10:52:40.648396 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:40.648360    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28eb33973c48f7bdbf2d52730496ba9.slice/crio-3a819e0f0f89fd4a6c6a74c9d23ce6296a14a83ea1185a3caf0664a604c22661 WatchSource:0}: Error finding container 3a819e0f0f89fd4a6c6a74c9d23ce6296a14a83ea1185a3caf0664a604c22661: Status 404 returned error can't find the container with id 3a819e0f0f89fd4a6c6a74c9d23ce6296a14a83ea1185a3caf0664a604c22661
Jul 17 10:52:40.654811 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.654795    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 10:52:40.677479 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.677439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal" event={"ID":"b28eb33973c48f7bdbf2d52730496ba9","Type":"ContainerStarted","Data":"3a819e0f0f89fd4a6c6a74c9d23ce6296a14a83ea1185a3caf0664a604c22661"}
Jul 17 10:52:40.680603 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.680581    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.742484 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.742461    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:40.781001 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.780975    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.881251 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.881220    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:40.918669 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:40.918619    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:40.982019 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:40.981989    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:41.082564 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.082529    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-178.ec2.internal\" not found"
Jul 17 10:52:41.116236 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.116198    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:41.177289 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.177213    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:41.191795 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.191768    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 10:52:41.192922 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.192903    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal"
Jul 17 10:52:41.201426 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.201406    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 10:52:41.401576 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.401552    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc6d4e274b58fd0b6a9631751aad296.slice/crio-b4470a9408a65c0f352ebef8c808ccb869c4b211af9e802e66ba79c2965ced44 WatchSource:0}: Error finding container b4470a9408a65c0f352ebef8c808ccb869c4b211af9e802e66ba79c2965ced44: Status 404 returned error can't find the container with id b4470a9408a65c0f352ebef8c808ccb869c4b211af9e802e66ba79c2965ced44
Jul 17 10:52:41.421577 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.421548    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 10:52:41.556769 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.556696    2562 apiserver.go:52] "Watching apiserver"
Jul 17 10:52:41.563786 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.563762    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 10:52:41.564162 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.564133    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zlghh","kube-system/konnectivity-agent-9k72q","kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal","openshift-multus/network-metrics-daemon-9x24l","openshift-ovn-kubernetes/ovnkube-node-j7gql","openshift-cluster-node-tuning-operator/tuned-ztc7c","openshift-dns/node-resolver-qr4cc","openshift-image-registry/node-ca-7hsm8","openshift-multus/multus-additional-cni-plugins-rbjl7","openshift-multus/multus-m6drf","openshift-network-diagnostics/network-check-target-srht5","openshift-network-operator/iptables-alerter-5dm47"]
Jul 17 10:52:41.565815 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.565794    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.566894 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.566875    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.567908 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.567887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.568554 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.568538    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 10:52:41.569092 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.568932    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 10:52:41.569092 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.568997    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 10:52:41.569246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.569231    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 10:52:41.570523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.569501    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 10:52:41.570523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.569726    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 10:52:41.570523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.570018    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 10:52:41.570523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.570088    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 10:52:41.570523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.570232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pd87q\""
Jul 17 10:52:41.570523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.570342    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2szhr\""
Jul 17 10:52:41.570819 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.570612    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 10:52:41.570819 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.570724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.571797 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.571702    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 10:52:41.571880 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.571442    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 10:52:41.571880 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.571870    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.571969 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.571925    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:52:41.573196 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.572950    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 10:52:41.573196 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.572980    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 10:52:41.573196 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.573094    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9cgqn\""
Jul 17 10:52:41.573196 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.573130    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 10:52:41.573674 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.573502    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 10:52:41.573674 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.573539    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 10:52:41.573674 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.573659    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d4spl\""
Jul 17 10:52:41.575263 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.574855    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:41.575263 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.574939    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:41.575856 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.575838    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 10:52:41.576502 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.576297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.576924 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.576885    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 10:52:41.576924 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.576892    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:52:41.577118 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.577061    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v2j8r\""
Jul 17 10:52:41.577630 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.577612    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:41.577707 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.577665    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:41.578338 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.578322    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 10:52:41.578414 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.578378    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 10:52:41.578621 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.578600    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lvb6d\""
Jul 17 10:52:41.578722 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.578707    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:52:41.579757 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.579740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.580770 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.580756    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 10:52:41.580971 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.580775    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 10:52:41.581053 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.580841    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9x5n6\""
Jul 17 10:52:41.581150 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.581134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.581206 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.581188    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:41.581908 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.581889    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 10:52:41.582333 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.582061    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-br8zw\""
Jul 17 10:52:41.582333 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.582171    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 10:52:41.582333 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.582088    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 10:52:41.582333 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.582223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.584509 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584492    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9fdpn\""
Jul 17 10:52:41.584612 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584592    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-cni-netd\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.584700 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0286f029-cca9-4df3-a452-b11e80f99247-tmp-dir\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.584700 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584648    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 10:52:41.584700 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-lib-modules\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.584700 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q5jk\" (UniqueName: \"kubernetes.io/projected/0286f029-cca9-4df3-a452-b11e80f99247-kube-api-access-8q5jk\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.584811 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:41.584811 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.584811 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-systemd-units\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.584811 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-slash\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.584978 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8960a7c1-927d-4fa1-b4f3-64bd317483fc-host-slash\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.584978 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-run\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.584978 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-cni-bin\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.584978 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-env-overrides\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.584978 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0286f029-cca9-4df3-a452-b11e80f99247-hosts-file\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.584978 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.584978 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-kubernetes\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.584982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-kubelet\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8960a7c1-927d-4fa1-b4f3-64bd317483fc-iptables-alerter-script\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4hrd\" (UniqueName: \"kubernetes.io/projected/475bd173-f49b-4583-a4ca-258543fe2ef9-kube-api-access-l4hrd\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-etc-selinux\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-sys\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-host\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovnkube-script-lib\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-registration-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6fwt\" (UniqueName: \"kubernetes.io/projected/236a7d91-85e2-43a9-a4be-380658856ec0-kube-api-access-m6fwt\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-systemd\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585298 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585316    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-modprobe-d\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovn-node-metrics-cert\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysctl-conf\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwz9c\" (UniqueName: \"kubernetes.io/projected/8960a7c1-927d-4fa1-b4f3-64bd317483fc-kube-api-access-wwz9c\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-socket-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-var-lib-kubelet\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/236a7d91-85e2-43a9-a4be-380658856ec0-etc-tuned\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585547    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-node-log\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysconfig\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-var-lib-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysctl-d\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.585849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-ovn\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-cnibin\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-device-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m97fb\" (UniqueName: \"kubernetes.io/projected/ffed8551-0aad-4867-8a38-4d5fd0c85478-kube-api-access-m97fb\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-log-socket\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhm9s\" (UniqueName: \"kubernetes.io/projected/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-kube-api-access-dhm9s\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-system-cni-dir\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-os-release\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-etc-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvx69\" (UniqueName: \"kubernetes.io/projected/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-kube-api-access-jvx69\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.585993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovnkube-config\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.586019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-sys-fs\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.586040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-systemd\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.586068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236a7d91-85e2-43a9-a4be-380658856ec0-tmp\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.586550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.586106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-run-netns\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.587615 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.587597    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 10:52:41.608436 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.608411    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hvfjl"
Jul 17 10:52:41.614063 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.614043    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hvfjl"
Jul 17 10:52:41.676858 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.676830    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 10:52:41.679818 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.679764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal" event={"ID":"acc6d4e274b58fd0b6a9631751aad296","Type":"ContainerStarted","Data":"b4470a9408a65c0f352ebef8c808ccb869c4b211af9e802e66ba79c2965ced44"}
Jul 17 10:52:41.687037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-lib-modules\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.687165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q5jk\" (UniqueName: \"kubernetes.io/projected/0286f029-cca9-4df3-a452-b11e80f99247-kube-api-access-8q5jk\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.687165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:41.687165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.687165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-socket-dir-parent\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.687165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-systemd-units\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.687165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-slash\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8960a7c1-927d-4fa1-b4f3-64bd317483fc-host-slash\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-run\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-k8s-cni-cncf-io\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687223    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-lib-modules\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-cni-bin\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-env-overrides\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687281    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-slash\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0286f029-cca9-4df3-a452-b11e80f99247-hosts-file\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-systemd-units\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8960a7c1-927d-4fa1-b4f3-64bd317483fc-host-slash\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-kubernetes\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687373    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-run\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-netns\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-cni-bin\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-cni-bin\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.687480 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-kubelet\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8960a7c1-927d-4fa1-b4f3-64bd317483fc-iptables-alerter-script\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687494    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-kubernetes\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hrd\" (UniqueName: \"kubernetes.io/projected/475bd173-f49b-4583-a4ca-258543fe2ef9-kube-api-access-l4hrd\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687523    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-etc-selinux\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687539    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0286f029-cca9-4df3-a452-b11e80f99247-hosts-file\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-sys\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-sys\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687700    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-etc-selinux\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-host\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687765    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.687788    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovnkube-script-lib\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687767    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-env-overrides\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-host\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.688246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-serviceca\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-kubelet\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687863    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.687877    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs podName:7a16b5bd-822c-46a6-b5d4-d1107c5a22eb nodeName:}" failed. No retries permitted until 2026-07-17 10:52:42.187832737 +0000 UTC m=+2.992858197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs") pod "network-metrics-daemon-9x24l" (UID: "7a16b5bd-822c-46a6-b5d4-d1107c5a22eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687894    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687919    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-system-cni-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-etc-kubernetes\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.687967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-registration-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6fwt\" (UniqueName: \"kubernetes.io/projected/236a7d91-85e2-43a9-a4be-380658856ec0-kube-api-access-m6fwt\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8960a7c1-927d-4fa1-b4f3-64bd317483fc-iptables-alerter-script\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688029    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-registration-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-dbus\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-daemon-config\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-systemd\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-modprobe-d\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.689028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh8l8\" (UniqueName: \"kubernetes.io/projected/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-kube-api-access-xh8l8\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c39e53a-22b1-488f-9327-4acaa2c3c3ab-konnectivity-ca\") pod \"konnectivity-agent-9k72q\" (UID: \"5c39e53a-22b1-488f-9327-4acaa2c3c3ab\") " pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688232    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovn-node-metrics-cert\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-systemd\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688277    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovnkube-script-lib\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688365    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-modprobe-d\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysctl-conf\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwz9c\" (UniqueName: \"kubernetes.io/projected/8960a7c1-927d-4fa1-b4f3-64bd317483fc-kube-api-access-wwz9c\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-socket-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-var-lib-kubelet\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/236a7d91-85e2-43a9-a4be-380658856ec0-etc-tuned\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b11b39-b9f4-43b5-83dd-342bc197da0f-cni-binary-copy\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688584    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-cni-multus\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-socket-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.689778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-node-log\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-node-log\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysconfig\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/475bd173-f49b-4583-a4ca-258543fe2ef9-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688926    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysconfig\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688931    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-var-lib-kubelet\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-cni-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysctl-conf\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.688997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-multus-certs\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-var-lib-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysctl-d\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-var-lib-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-run-ovn-kubernetes\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-host\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.690530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-kubelet\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-hostroot\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-ovn\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689210    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-sysctl-d\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-cnibin\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-device-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m97fb\" (UniqueName: \"kubernetes.io/projected/ffed8551-0aad-4867-8a38-4d5fd0c85478-kube-api-access-m97fb\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-log-socket\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-cnibin\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689261    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-run-ovn\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhm9s\" (UniqueName: \"kubernetes.io/projected/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-kube-api-access-dhm9s\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-device-dir\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-system-cni-dir\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-os-release\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689380    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-system-cni-dir\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.691303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-log-socket\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c39e53a-22b1-488f-9327-4acaa2c3c3ab-agent-certs\") pod \"konnectivity-agent-9k72q\" (UID: \"5c39e53a-22b1-488f-9327-4acaa2c3c3ab\") " pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/475bd173-f49b-4583-a4ca-258543fe2ef9-os-release\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-kubelet-config\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-os-release\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-etc-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvx69\" (UniqueName: \"kubernetes.io/projected/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-kube-api-access-jvx69\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-cnibin\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-conf-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r4tf\" (UniqueName: \"kubernetes.io/projected/55b11b39-b9f4-43b5-83dd-342bc197da0f-kube-api-access-5r4tf\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovnkube-config\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689682    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-etc-openvswitch\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-sys-fs\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-systemd\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236a7d91-85e2-43a9-a4be-380658856ec0-tmp\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-run-netns\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-cni-netd\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692048 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/236a7d91-85e2-43a9-a4be-380658856ec0-etc-systemd\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0286f029-cca9-4df3-a452-b11e80f99247-tmp-dir\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffed8551-0aad-4867-8a38-4d5fd0c85478-sys-fs\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689933    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-run-netns\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.689945    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-host-cni-netd\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.690102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovnkube-config\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.690217    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0286f029-cca9-4df3-a452-b11e80f99247-tmp-dir\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.691874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/236a7d91-85e2-43a9-a4be-380658856ec0-etc-tuned\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.691970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-ovn-node-metrics-cert\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.692597 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.692097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236a7d91-85e2-43a9-a4be-380658856ec0-tmp\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.699955 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.699936    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q5jk\" (UniqueName: \"kubernetes.io/projected/0286f029-cca9-4df3-a452-b11e80f99247-kube-api-access-8q5jk\") pod \"node-resolver-qr4cc\" (UID: \"0286f029-cca9-4df3-a452-b11e80f99247\") " pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.700827 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.700593    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:41.700827 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.700617    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:41.700827 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.700630    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tbkdr for pod openshift-network-diagnostics/network-check-target-srht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:41.700827 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.700686    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr podName:8b48f25d-3815-44f0-b302-cee524354a67 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:42.20066749 +0000 UTC m=+3.005692971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tbkdr" (UniqueName: "kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr") pod "network-check-target-srht5" (UID: "8b48f25d-3815-44f0-b302-cee524354a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:41.701128 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.700892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhm9s\" (UniqueName: \"kubernetes.io/projected/a6d2e791-c1b5-4cdf-a323-aab9ba1fd637-kube-api-access-dhm9s\") pod \"ovnkube-node-j7gql\" (UID: \"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637\") " pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.702852 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.702811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6fwt\" (UniqueName: \"kubernetes.io/projected/236a7d91-85e2-43a9-a4be-380658856ec0-kube-api-access-m6fwt\") pod \"tuned-ztc7c\" (UID: \"236a7d91-85e2-43a9-a4be-380658856ec0\") " pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.703391 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.703369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwz9c\" (UniqueName: \"kubernetes.io/projected/8960a7c1-927d-4fa1-b4f3-64bd317483fc-kube-api-access-wwz9c\") pod \"iptables-alerter-5dm47\" (UID: \"8960a7c1-927d-4fa1-b4f3-64bd317483fc\") " pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.708265 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.708241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hrd\" (UniqueName: \"kubernetes.io/projected/475bd173-f49b-4583-a4ca-258543fe2ef9-kube-api-access-l4hrd\") pod \"multus-additional-cni-plugins-rbjl7\" (UID: \"475bd173-f49b-4583-a4ca-258543fe2ef9\") " pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.708398 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.708376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvx69\" (UniqueName: \"kubernetes.io/projected/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-kube-api-access-jvx69\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:41.710515 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.710498    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m97fb\" (UniqueName: \"kubernetes.io/projected/ffed8551-0aad-4867-8a38-4d5fd0c85478-kube-api-access-m97fb\") pod \"aws-ebs-csi-driver-node-dr2gr\" (UID: \"ffed8551-0aad-4867-8a38-4d5fd0c85478\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.790680 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-cnibin\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.790790 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-conf-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.790790 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r4tf\" (UniqueName: \"kubernetes.io/projected/55b11b39-b9f4-43b5-83dd-342bc197da0f-kube-api-access-5r4tf\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.790790 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-socket-dir-parent\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.790790 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-k8s-cni-cncf-io\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.790790 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-netns\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.790790 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-cni-bin\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-serviceca\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-system-cni-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-etc-kubernetes\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790858    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-dbus\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-daemon-config\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh8l8\" (UniqueName: \"kubernetes.io/projected/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-kube-api-access-xh8l8\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c39e53a-22b1-488f-9327-4acaa2c3c3ab-konnectivity-ca\") pod \"konnectivity-agent-9k72q\" (UID: \"5c39e53a-22b1-488f-9327-4acaa2c3c3ab\") " pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b11b39-b9f4-43b5-83dd-342bc197da0f-cni-binary-copy\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-cni-multus\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-cni-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-multus-certs\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.790984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-host\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-kubelet\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-hostroot\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c39e53a-22b1-488f-9327-4acaa2c3c3ab-agent-certs\") pod \"konnectivity-agent-9k72q\" (UID: \"5c39e53a-22b1-488f-9327-4acaa2c3c3ab\") " pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:52:41.791049 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-kubelet-config\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-os-release\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-os-release\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791220    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-netns\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.791264    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791272    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-etc-kubernetes\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-socket-dir-parent\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:41.791326    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret podName:72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:42.291310398 +0000 UTC m=+3.096335860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret") pod "global-pull-secret-syncer-zlghh" (UID: "72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791352    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-k8s-cni-cncf-io\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-cni-bin\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791207    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-dbus\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-system-cni-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-cnibin\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-conf-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-cni-multus\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791734    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-daemon-config\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.791783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791787    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-host\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.792457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791788    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-serviceca\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.792457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-var-lib-kubelet\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.792457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791916    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-hostroot\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.792457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791929    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c39e53a-22b1-488f-9327-4acaa2c3c3ab-konnectivity-ca\") pod \"konnectivity-agent-9k72q\" (UID: \"5c39e53a-22b1-488f-9327-4acaa2c3c3ab\") " pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:52:41.792457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.791962    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-host-run-multus-certs\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.792457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.792040    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55b11b39-b9f4-43b5-83dd-342bc197da0f-multus-cni-dir\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.792457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.792092    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-kubelet-config\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:41.792457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.792106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55b11b39-b9f4-43b5-83dd-342bc197da0f-cni-binary-copy\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.796127 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.796107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c39e53a-22b1-488f-9327-4acaa2c3c3ab-agent-certs\") pod \"konnectivity-agent-9k72q\" (UID: \"5c39e53a-22b1-488f-9327-4acaa2c3c3ab\") " pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:52:41.812005 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.811949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r4tf\" (UniqueName: \"kubernetes.io/projected/55b11b39-b9f4-43b5-83dd-342bc197da0f-kube-api-access-5r4tf\") pod \"multus-m6drf\" (UID: \"55b11b39-b9f4-43b5-83dd-342bc197da0f\") " pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.815182 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.815161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh8l8\" (UniqueName: \"kubernetes.io/projected/56c2b59f-ee0b-4bb6-904b-67cd4de9ea38-kube-api-access-xh8l8\") pod \"node-ca-7hsm8\" (UID: \"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38\") " pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.878818 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.878793    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:52:41.886693 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.886672    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr"
Jul 17 10:52:41.888122 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.888063    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d2e791_c1b5_4cdf_a323_aab9ba1fd637.slice/crio-581ce37d50fef94945e5b887895e632c89ddc6fafcbffb9a0de9101c60154906 WatchSource:0}: Error finding container 581ce37d50fef94945e5b887895e632c89ddc6fafcbffb9a0de9101c60154906: Status 404 returned error can't find the container with id 581ce37d50fef94945e5b887895e632c89ddc6fafcbffb9a0de9101c60154906
Jul 17 10:52:41.893499 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.893479    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rbjl7"
Jul 17 10:52:41.896372 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.896345    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffed8551_0aad_4867_8a38_4d5fd0c85478.slice/crio-faa0dd5cb02712a8c854c9503950adfb9c2dcae4d219bf06d8af86fc468c13b7 WatchSource:0}: Error finding container faa0dd5cb02712a8c854c9503950adfb9c2dcae4d219bf06d8af86fc468c13b7: Status 404 returned error can't find the container with id faa0dd5cb02712a8c854c9503950adfb9c2dcae4d219bf06d8af86fc468c13b7
Jul 17 10:52:41.898488 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.898454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5dm47"
Jul 17 10:52:41.904743 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.904563    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ztc7c"
Jul 17 10:52:41.910036 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.910013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qr4cc"
Jul 17 10:52:41.911552 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.911530    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8960a7c1_927d_4fa1_b4f3_64bd317483fc.slice/crio-f844e2d5d48f942563c3ad0c31d62000a3f37bd58cba27512ff147b6ae8aba2f WatchSource:0}: Error finding container f844e2d5d48f942563c3ad0c31d62000a3f37bd58cba27512ff147b6ae8aba2f: Status 404 returned error can't find the container with id f844e2d5d48f942563c3ad0c31d62000a3f37bd58cba27512ff147b6ae8aba2f
Jul 17 10:52:41.916485 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.916356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:52:41.916647 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.916626    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236a7d91_85e2_43a9_a4be_380658856ec0.slice/crio-314302a364937dc523c7a95b997c61884baa2d5f1d4860e1ddad7f0f03999626 WatchSource:0}: Error finding container 314302a364937dc523c7a95b997c61884baa2d5f1d4860e1ddad7f0f03999626: Status 404 returned error can't find the container with id 314302a364937dc523c7a95b997c61884baa2d5f1d4860e1ddad7f0f03999626
Jul 17 10:52:41.920511 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.920490    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0286f029_cca9_4df3_a452_b11e80f99247.slice/crio-6f154f3d70138e103cb9ddfe8052cc0cffde135c497312bca092ac3d4111a2c9 WatchSource:0}: Error finding container 6f154f3d70138e103cb9ddfe8052cc0cffde135c497312bca092ac3d4111a2c9: Status 404 returned error can't find the container with id 6f154f3d70138e103cb9ddfe8052cc0cffde135c497312bca092ac3d4111a2c9
Jul 17 10:52:41.924736 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.924688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7hsm8"
Jul 17 10:52:41.927169 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.927127    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c39e53a_22b1_488f_9327_4acaa2c3c3ab.slice/crio-d0fd12b0873718479e0e364925b904bbabc3a45f59edeea8981ce2166f5271f9 WatchSource:0}: Error finding container d0fd12b0873718479e0e364925b904bbabc3a45f59edeea8981ce2166f5271f9: Status 404 returned error can't find the container with id d0fd12b0873718479e0e364925b904bbabc3a45f59edeea8981ce2166f5271f9
Jul 17 10:52:41.927660 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:41.927647    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m6drf"
Jul 17 10:52:41.939033 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.939012    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b11b39_b9f4_43b5_83dd_342bc197da0f.slice/crio-31f459c359f710fb7399eeae432404a5c2d50fb16bcf1d30e21803b736e571e9 WatchSource:0}: Error finding container 31f459c359f710fb7399eeae432404a5c2d50fb16bcf1d30e21803b736e571e9: Status 404 returned error can't find the container with id 31f459c359f710fb7399eeae432404a5c2d50fb16bcf1d30e21803b736e571e9
Jul 17 10:52:41.939422 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:52:41.939400    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c2b59f_ee0b_4bb6_904b_67cd4de9ea38.slice/crio-d558f35ab92829a7f80307ed02c02052f4c840ca01ae2b4d6d650ff481378e05 WatchSource:0}: Error finding container d558f35ab92829a7f80307ed02c02052f4c840ca01ae2b4d6d650ff481378e05: Status 404 returned error can't find the container with id d558f35ab92829a7f80307ed02c02052f4c840ca01ae2b4d6d650ff481378e05
Jul 17 10:52:42.192996 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.192807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:42.193136 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.192952    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:42.193136 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.193127    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs podName:7a16b5bd-822c-46a6-b5d4-d1107c5a22eb nodeName:}" failed. No retries permitted until 2026-07-17 10:52:43.193113 +0000 UTC m=+3.998138461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs") pod "network-metrics-daemon-9x24l" (UID: "7a16b5bd-822c-46a6-b5d4-d1107c5a22eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:42.295003 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.294245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:42.295003 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.294326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:42.295003 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.294485    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:42.295003 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.294502    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:42.295003 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.294513    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tbkdr for pod openshift-network-diagnostics/network-check-target-srht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:42.295003 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.294567    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr podName:8b48f25d-3815-44f0-b302-cee524354a67 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:43.29455073 +0000 UTC m=+4.099576205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbkdr" (UniqueName: "kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr") pod "network-check-target-srht5" (UID: "8b48f25d-3815-44f0-b302-cee524354a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:42.295003 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.294920    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:42.295003 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.294963    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret podName:72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:43.294949998 +0000 UTC m=+4.099975463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret") pod "global-pull-secret-syncer-zlghh" (UID: "72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:42.616775 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.616714    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 10:47:41 +0000 UTC" deadline="2028-01-08 13:49:17.157326004 +0000 UTC"
Jul 17 10:52:42.616775 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.616773    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12962h56m34.54055665s"
Jul 17 10:52:42.674421 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.674328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:42.674421 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.674367    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:42.674650 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.674459    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:42.674650 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:42.674604    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:42.687496 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.687438    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ztc7c" event={"ID":"236a7d91-85e2-43a9-a4be-380658856ec0","Type":"ContainerStarted","Data":"314302a364937dc523c7a95b997c61884baa2d5f1d4860e1ddad7f0f03999626"}
Jul 17 10:52:42.689041 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.688843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr" event={"ID":"ffed8551-0aad-4867-8a38-4d5fd0c85478","Type":"ContainerStarted","Data":"faa0dd5cb02712a8c854c9503950adfb9c2dcae4d219bf06d8af86fc468c13b7"}
Jul 17 10:52:42.692920 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.692131    2562 generic.go:356] "Generic (PLEG): container finished" podID="b28eb33973c48f7bdbf2d52730496ba9" containerID="cff920f11c805370a693e2257150f6a7cbbf263bd50263af43babce18025febf" exitCode=0
Jul 17 10:52:42.692920 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.692721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal" event={"ID":"b28eb33973c48f7bdbf2d52730496ba9","Type":"ContainerDied","Data":"cff920f11c805370a693e2257150f6a7cbbf263bd50263af43babce18025febf"}
Jul 17 10:52:42.695957 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.695911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m6drf" event={"ID":"55b11b39-b9f4-43b5-83dd-342bc197da0f","Type":"ContainerStarted","Data":"31f459c359f710fb7399eeae432404a5c2d50fb16bcf1d30e21803b736e571e9"}
Jul 17 10:52:42.700011 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.699960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9k72q" event={"ID":"5c39e53a-22b1-488f-9327-4acaa2c3c3ab","Type":"ContainerStarted","Data":"d0fd12b0873718479e0e364925b904bbabc3a45f59edeea8981ce2166f5271f9"}
Jul 17 10:52:42.701871 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.701807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qr4cc" event={"ID":"0286f029-cca9-4df3-a452-b11e80f99247","Type":"ContainerStarted","Data":"6f154f3d70138e103cb9ddfe8052cc0cffde135c497312bca092ac3d4111a2c9"}
Jul 17 10:52:42.703448 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.703391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5dm47" event={"ID":"8960a7c1-927d-4fa1-b4f3-64bd317483fc","Type":"ContainerStarted","Data":"f844e2d5d48f942563c3ad0c31d62000a3f37bd58cba27512ff147b6ae8aba2f"}
Jul 17 10:52:42.704956 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.704930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" event={"ID":"475bd173-f49b-4583-a4ca-258543fe2ef9","Type":"ContainerStarted","Data":"5d0161961e3c4075a6586408d92c20313cfb7e8a1f3620eb3bb5d1fd39749dce"}
Jul 17 10:52:42.706422 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.706388    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"581ce37d50fef94945e5b887895e632c89ddc6fafcbffb9a0de9101c60154906"}
Jul 17 10:52:42.708551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:42.708527    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7hsm8" event={"ID":"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38","Type":"ContainerStarted","Data":"d558f35ab92829a7f80307ed02c02052f4c840ca01ae2b4d6d650ff481378e05"}
Jul 17 10:52:43.201849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:43.201770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:43.202047 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.201985    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:43.202122 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.202050    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs podName:7a16b5bd-822c-46a6-b5d4-d1107c5a22eb nodeName:}" failed. No retries permitted until 2026-07-17 10:52:45.202033298 +0000 UTC m=+6.007058764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs") pod "network-metrics-daemon-9x24l" (UID: "7a16b5bd-822c-46a6-b5d4-d1107c5a22eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:43.303153 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:43.302575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:43.303153 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:43.302643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:43.303153 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.302749    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:43.303153 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.302811    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret podName:72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:45.302791051 +0000 UTC m=+6.107816515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret") pod "global-pull-secret-syncer-zlghh" (UID: "72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:43.303153 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.302747    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:43.303153 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.302851    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:43.303153 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.302866    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tbkdr for pod openshift-network-diagnostics/network-check-target-srht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:43.303153 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.302920    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr podName:8b48f25d-3815-44f0-b302-cee524354a67 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:45.302904191 +0000 UTC m=+6.107929657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbkdr" (UniqueName: "kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr") pod "network-check-target-srht5" (UID: "8b48f25d-3815-44f0-b302-cee524354a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:43.617568 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:43.617498    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 10:47:41 +0000 UTC" deadline="2028-01-01 01:14:56.707575487 +0000 UTC"
Jul 17 10:52:43.617568 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:43.617561    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12782h22m13.090018257s"
Jul 17 10:52:43.674452 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:43.674417    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:43.674627 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:43.674550    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:44.674993 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:44.674949    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:44.675447 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:44.675122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:44.675447 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:44.675132    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:44.675447 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:44.675244    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:45.221391 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:45.220804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:45.221391 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.220986    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:45.221391 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.221051    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs podName:7a16b5bd-822c-46a6-b5d4-d1107c5a22eb nodeName:}" failed. No retries permitted until 2026-07-17 10:52:49.221032886 +0000 UTC m=+10.026058353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs") pod "network-metrics-daemon-9x24l" (UID: "7a16b5bd-822c-46a6-b5d4-d1107c5a22eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:45.321984 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:45.321915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:45.322192 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:45.322008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:45.322192 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.322112    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:45.322192 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.322153    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:45.322192 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.322174    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:45.322192 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.322186    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret podName:72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:49.322166568 +0000 UTC m=+10.127192045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret") pod "global-pull-secret-syncer-zlghh" (UID: "72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:45.322192 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.322189    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tbkdr for pod openshift-network-diagnostics/network-check-target-srht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:45.322499 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.322240    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr podName:8b48f25d-3815-44f0-b302-cee524354a67 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:49.322224311 +0000 UTC m=+10.127249777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbkdr" (UniqueName: "kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr") pod "network-check-target-srht5" (UID: "8b48f25d-3815-44f0-b302-cee524354a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:45.677386 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:45.676822    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:45.677386 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:45.676951    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:46.674090 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:46.674048    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:46.674277 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:46.674171    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:46.674507 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:46.674491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:46.674586 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:46.674571    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:47.675267 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:47.675224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:47.675733 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:47.675367    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:48.675183 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:48.675129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:48.675371 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:48.675268    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:48.675371 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:48.675129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:48.675371 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:48.675363    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:49.259509 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:49.259023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:49.259509 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.259228    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:49.259509 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.259289    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs podName:7a16b5bd-822c-46a6-b5d4-d1107c5a22eb nodeName:}" failed. No retries permitted until 2026-07-17 10:52:57.259270238 +0000 UTC m=+18.064295705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs") pod "network-metrics-daemon-9x24l" (UID: "7a16b5bd-822c-46a6-b5d4-d1107c5a22eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:49.359611 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:49.359572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:49.359774 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:49.359658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:49.359774 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.359770    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:49.359899 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.359777    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:49.359899 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.359801    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:49.359899 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.359814    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tbkdr for pod openshift-network-diagnostics/network-check-target-srht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:49.359899 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.359828    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret podName:72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:57.35980972 +0000 UTC m=+18.164835202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret") pod "global-pull-secret-syncer-zlghh" (UID: "72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:49.359899 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.359864    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr podName:8b48f25d-3815-44f0-b302-cee524354a67 nodeName:}" failed. No retries permitted until 2026-07-17 10:52:57.359847726 +0000 UTC m=+18.164873192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbkdr" (UniqueName: "kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr") pod "network-check-target-srht5" (UID: "8b48f25d-3815-44f0-b302-cee524354a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:49.675348 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:49.675317    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:49.675512 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:49.675415    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:50.675113 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:50.675036    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:50.675309 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:50.675183    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:50.675309 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:50.675240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:50.675411 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:50.675374    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:51.675427 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:51.674954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:51.675427 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:51.675099    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:52.674866 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:52.674814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:52.674866 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:52.674867    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:52.675107 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:52.674953    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:52.675107 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:52.675037    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:53.677562 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:53.677536    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:53.677957 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:53.677632    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:54.674479 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:54.674447    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:54.674664 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:54.674493    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:54.674664 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:54.674565    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:54.674778 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:54.674748    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:55.677296 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:55.677277    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:55.677545 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:55.677375    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:56.674588 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:56.674555    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:56.674816 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:56.674602    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:56.674816 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:56.674670    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:56.674816 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:56.674805    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:57.309432 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:57.309397    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:57.309983 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.309569    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:57.309983 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.309646    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs podName:7a16b5bd-822c-46a6-b5d4-d1107c5a22eb nodeName:}" failed. No retries permitted until 2026-07-17 10:53:13.309626045 +0000 UTC m=+34.114651518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs") pod "network-metrics-daemon-9x24l" (UID: "7a16b5bd-822c-46a6-b5d4-d1107c5a22eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 10:52:57.410355 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:57.410315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:57.410535 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:57.410387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:57.410535 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.410478    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:57.410535 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.410492    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 10:52:57.410535 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.410506    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 10:52:57.410535 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.410518    2562 projected.go:196] Error preparing data for projected volume kube-api-access-tbkdr for pod openshift-network-diagnostics/network-check-target-srht5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:57.410750 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.410542    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret podName:72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:13.410524353 +0000 UTC m=+34.215549838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret") pod "global-pull-secret-syncer-zlghh" (UID: "72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9") : object "kube-system"/"original-pull-secret" not registered
Jul 17 10:52:57.410750 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.410558    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr podName:8b48f25d-3815-44f0-b302-cee524354a67 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:13.410550712 +0000 UTC m=+34.215576189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tbkdr" (UniqueName: "kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr") pod "network-check-target-srht5" (UID: "8b48f25d-3815-44f0-b302-cee524354a67") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 10:52:57.674572 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:57.674522    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:57.674751 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:57.674670    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:52:58.674568 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:58.674531    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:52:58.675070 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:58.674658    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:52:58.675070 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:58.674710    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:52:58.675070 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:58.674840    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:52:59.675373 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:52:59.675304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:52:59.675737 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:52:59.675388    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:53:00.674697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.674395    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:00.674813 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.674395    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:00.674871 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:00.674813    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:53:00.674925 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:00.674904    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:53:00.744382 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.744342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"7737887822e71b360018600fd43059007d9c755c5111223881d3d6b70b0e0323"}
Jul 17 10:53:00.745153 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.744445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"7d84ad5d2320c64391d5fc7d7a35fc220dcb3daaafe0083d4c64fa319b2a0b62"}
Jul 17 10:53:00.745153 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.744497    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"3a205593b315282dd4d53e846797f61409aa68111343c0adbad51c2a8db0c1cd"}
Jul 17 10:53:00.745153 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.744533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"3554d6b3b0ddc4a3e44b38233fe81753b08fc49bb598f22460e79ef117e35999"}
Jul 17 10:53:00.745153 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.744563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"a589d5ecf586b7b12e51ca14a2d76b5355b8f8d07535178638c6cf9ecad3f5dd"}
Jul 17 10:53:00.745153 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.744590    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"fa7b8a7e87ba7b2b55bb1c05a156dcdfb62a983dc9baf3ba99a911395db4896f"}
Jul 17 10:53:00.746043 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.746009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7hsm8" event={"ID":"56c2b59f-ee0b-4bb6-904b-67cd4de9ea38","Type":"ContainerStarted","Data":"8e956a4634be92ac9ba9c1bf0c7fc277b67cc258d83a658abc09d2298dd6b2c1"}
Jul 17 10:53:00.747462 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.747442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ztc7c" event={"ID":"236a7d91-85e2-43a9-a4be-380658856ec0","Type":"ContainerStarted","Data":"00e8428a479beeb3ebc757e2527e5e2ed765f7e879405fc9f52eba1470ec2c2c"}
Jul 17 10:53:00.748854 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.748832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr" event={"ID":"ffed8551-0aad-4867-8a38-4d5fd0c85478","Type":"ContainerStarted","Data":"4d0b7c5bf1f8cb3dc3de43bcd5bba33ad229cf4a9018d0a97e8cd7b1ba8fc8d4"}
Jul 17 10:53:00.750763 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.750739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal" event={"ID":"b28eb33973c48f7bdbf2d52730496ba9","Type":"ContainerStarted","Data":"6c2eef5c5c8e83b0cc652c8fc938212db4a65265b45e796bd725cf5eac6b9ed8"}
Jul 17 10:53:00.752072 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.752049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal" event={"ID":"acc6d4e274b58fd0b6a9631751aad296","Type":"ContainerStarted","Data":"b8aa25773234b71597d37ed5aed3f5fd8a6662c674e4a20c671e74cdad59f90f"}
Jul 17 10:53:00.753426 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.753407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m6drf" event={"ID":"55b11b39-b9f4-43b5-83dd-342bc197da0f","Type":"ContainerStarted","Data":"806ea2d50512ba04abf37eadcfacdf98f40c8b81305608538e60947859c5f2ea"}
Jul 17 10:53:00.754862 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.754834    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9k72q" event={"ID":"5c39e53a-22b1-488f-9327-4acaa2c3c3ab","Type":"ContainerStarted","Data":"13aa68014c4b980168c9392e0b4519ab6af21860e46eaa94486242bda2b8ac0d"}
Jul 17 10:53:00.756149 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.756130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qr4cc" event={"ID":"0286f029-cca9-4df3-a452-b11e80f99247","Type":"ContainerStarted","Data":"de701f150ea09eb9c6abaf5bc7783883cc41daa4b529769690266154a471c0c1"}
Jul 17 10:53:00.757529 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.757509    2562 generic.go:356] "Generic (PLEG): container finished" podID="475bd173-f49b-4583-a4ca-258543fe2ef9" containerID="4ced0ae4a2e93baf0d2f9c57de4d0a32acfa267f39203e514a79d77eccfc3cdc" exitCode=0
Jul 17 10:53:00.757608 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.757541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" event={"ID":"475bd173-f49b-4583-a4ca-258543fe2ef9","Type":"ContainerDied","Data":"4ced0ae4a2e93baf0d2f9c57de4d0a32acfa267f39203e514a79d77eccfc3cdc"}
Jul 17 10:53:00.763396 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.763354    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7hsm8" podStartSLOduration=4.010163765 podStartE2EDuration="21.763341354s" totalImagesPullingTime="17.753177589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:00.763098702 +0000 UTC m=+21.568124181" watchObservedRunningTime="2026-07-17 10:53:00.763341354 +0000 UTC m=+21.568366839"
Jul 17 10:53:00.785942 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.785901    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m6drf" podStartSLOduration=3.94279243 podStartE2EDuration="21.785886673s" totalImagesPullingTime="17.843094243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:00.785698415 +0000 UTC m=+21.590723901" watchObservedRunningTime="2026-07-17 10:53:00.785886673 +0000 UTC m=+21.590912158"
Jul 17 10:53:00.801660 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.801626    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-178.ec2.internal" podStartSLOduration=19.801612968 podStartE2EDuration="19.801612968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:00.801597062 +0000 UTC m=+21.606622548" watchObservedRunningTime="2026-07-17 10:53:00.801612968 +0000 UTC m=+21.606638444"
Jul 17 10:53:00.817411 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.817370    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-178.ec2.internal" podStartSLOduration=19.817357121 podStartE2EDuration="19.817357121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:00.81696984 +0000 UTC m=+21.621995324" watchObservedRunningTime="2026-07-17 10:53:00.817357121 +0000 UTC m=+21.622382605"
Jul 17 10:53:00.837270 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.837232    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ztc7c" podStartSLOduration=4.060216213 podStartE2EDuration="21.83721931s" totalImagesPullingTime="17.777003097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:00.837125727 +0000 UTC m=+21.642151211" watchObservedRunningTime="2026-07-17 10:53:00.83721931 +0000 UTC m=+21.642244796"
Jul 17 10:53:00.856537 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.856499    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qr4cc" podStartSLOduration=8.104473386 podStartE2EDuration="21.856486611s" totalImagesPullingTime="13.752013225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:00.856023135 +0000 UTC m=+21.661048619" watchObservedRunningTime="2026-07-17 10:53:00.856486611 +0000 UTC m=+21.661512095"
Jul 17 10:53:00.894405 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.894366    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9k72q" podStartSLOduration=4.128839142 podStartE2EDuration="21.894353324s" totalImagesPullingTime="17.765514182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:00.871453387 +0000 UTC m=+21.676478872" watchObservedRunningTime="2026-07-17 10:53:00.894353324 +0000 UTC m=+21.699378786"
Jul 17 10:53:00.936429 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:00.936402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:01.003246 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:01.003156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:01.674309 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:01.674281    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:01.674608 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:01.674484    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:53:01.762715 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:01.762631    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5dm47" event={"ID":"8960a7c1-927d-4fa1-b4f3-64bd317483fc","Type":"ContainerStarted","Data":"63143fe8cfdf0bbb90228ef5375946d9ecbf0872fa2b713470f2fafe1ba81934"}
Jul 17 10:53:01.780280 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:01.780224    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5dm47" podStartSLOduration=5.000256163 podStartE2EDuration="22.780201682s" totalImagesPullingTime="17.779945519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:01.779572141 +0000 UTC m=+22.584597627" watchObservedRunningTime="2026-07-17 10:53:01.780201682 +0000 UTC m=+22.585227168"
Jul 17 10:53:01.901334 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:01.901296    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:01.967270 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:01.967224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:01.987812 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:01.987785    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 10:53:02.171443 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.171412    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:53:02.172090 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.172053    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:53:02.664925 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.664827    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T10:53:01.987806953Z","UUID":"4c36aaf8-2e61-4b95-816b-71a521ad2bd9","Handler":null,"Name":"","Endpoint":""}
Jul 17 10:53:02.666443 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.666420    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 10:53:02.666571 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.666460    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 10:53:02.675127 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.675103    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:02.675247 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:02.675202    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:53:02.675305 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.675253    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:02.675365 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:02.675347    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:53:02.767922 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.767884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr" event={"ID":"ffed8551-0aad-4867-8a38-4d5fd0c85478","Type":"ContainerStarted","Data":"d84a73f7ac9f2e19bfcbc2dbbcc7bbc6f941ba4eb0009c980b7fbd8beb836db3"}
Jul 17 10:53:02.768430 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.768408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:53:02.768859 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.768839    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9k72q"
Jul 17 10:53:02.830033 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:02.829993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:03.674565 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:03.674529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:03.674756 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:03.674644    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:53:03.772207 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:03.772175    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr" event={"ID":"ffed8551-0aad-4867-8a38-4d5fd0c85478","Type":"ContainerStarted","Data":"570b3309edef4919bc4fa1fe6902a822f1291d4e470910891d45dcf8f36c0969"}
Jul 17 10:53:03.776759 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:03.776358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"45c7e4f8edc59d22bd4d132c8e2d45e7c14ad051d8019657e8b055b57d726a02"}
Jul 17 10:53:03.790830 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:03.790789    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dr2gr" podStartSLOduration=12.698973155000001 podStartE2EDuration="24.790774466s" totalImagesPullingTime="12.091801311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:03.790540919 +0000 UTC m=+24.595566424" watchObservedRunningTime="2026-07-17 10:53:03.790774466 +0000 UTC m=+24.595799951"
Jul 17 10:53:04.674999 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:04.674806    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:04.675168 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:04.674813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:04.675168 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:04.675104    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:53:04.675277 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:04.675206    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:53:05.674325 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.674289    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:05.674982 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:05.674395    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:53:05.782062 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.782030    2562 generic.go:356] "Generic (PLEG): container finished" podID="475bd173-f49b-4583-a4ca-258543fe2ef9" containerID="5b0ed0b16ea45b4766b4a77028c182bc6fc19ed6cc8598a95df22f0ba395fe09" exitCode=0
Jul 17 10:53:05.782252 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.782114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" event={"ID":"475bd173-f49b-4583-a4ca-258543fe2ef9","Type":"ContainerDied","Data":"5b0ed0b16ea45b4766b4a77028c182bc6fc19ed6cc8598a95df22f0ba395fe09"}
Jul 17 10:53:05.785806 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.785734    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" event={"ID":"a6d2e791-c1b5-4cdf-a323-aab9ba1fd637","Type":"ContainerStarted","Data":"0c072853a6151dc6e063a3a55cb8e407c273df0b6ff6b4b0ae14264c6452d421"}
Jul 17 10:53:05.786036 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.786016    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:53:05.786142 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.786100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:53:05.800661 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.800635    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:53:05.800852 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.800835    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:53:05.830969 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:05.830924    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql" podStartSLOduration=8.603944646 podStartE2EDuration="26.830910939s" totalImagesPullingTime="18.226966293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:05.829449104 +0000 UTC m=+26.634474589" watchObservedRunningTime="2026-07-17 10:53:05.830910939 +0000 UTC m=+26.635936424"
Jul 17 10:53:06.674875 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.674617    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:06.675303 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.674633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:06.675303 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:06.674983    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:53:06.675303 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:06.675034    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:53:06.790088 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.790042    2562 generic.go:356] "Generic (PLEG): container finished" podID="475bd173-f49b-4583-a4ca-258543fe2ef9" containerID="7d0adb9869b8052610412b5c92be715fde58d26209afe0f733495bf5cc441918" exitCode=0
Jul 17 10:53:06.790214 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.790178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" event={"ID":"475bd173-f49b-4583-a4ca-258543fe2ef9","Type":"ContainerDied","Data":"7d0adb9869b8052610412b5c92be715fde58d26209afe0f733495bf5cc441918"}
Jul 17 10:53:06.790263 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.790249    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 10:53:06.934257 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.934144    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zlghh"]
Jul 17 10:53:06.934395 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.934278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:06.934395 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:06.934371    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:53:06.938223 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.938194    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9x24l"]
Jul 17 10:53:06.938371 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.938294    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:06.938425 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:06.938386    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:53:06.946213 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.946191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srht5"]
Jul 17 10:53:06.946314 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:06.946280    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:06.946393 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:06.946369    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:53:07.795320 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:07.795218    2562 generic.go:356] "Generic (PLEG): container finished" podID="475bd173-f49b-4583-a4ca-258543fe2ef9" containerID="eecc66cb44821061ee568f4e7ed92a114f527df9a93116fa817fe5c8e1ec76f1" exitCode=0
Jul 17 10:53:07.795320 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:07.795292    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" event={"ID":"475bd173-f49b-4583-a4ca-258543fe2ef9","Type":"ContainerDied","Data":"eecc66cb44821061ee568f4e7ed92a114f527df9a93116fa817fe5c8e1ec76f1"}
Jul 17 10:53:07.795848 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:07.795406    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 10:53:08.302166 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:08.302133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:53:08.674427 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:08.674397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:08.674606 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:08.674459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:08.674606 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:08.674397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:08.674606 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:08.674503    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:53:08.674606 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:08.674575    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:53:08.674794 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:08.674644    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:53:10.674383 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:10.674150    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:10.674872 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:10.674191    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:10.674872 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:10.674462    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-srht5" podUID="8b48f25d-3815-44f0-b302-cee524354a67"
Jul 17 10:53:10.674872 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:10.674568    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zlghh" podUID="72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9"
Jul 17 10:53:10.674872 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:10.674191    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:10.674872 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:10.674678    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9x24l" podUID="7a16b5bd-822c-46a6-b5d4-d1107c5a22eb"
Jul 17 10:53:12.529773 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.529752    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-178.ec2.internal" event="NodeReady"
Jul 17 10:53:12.530253 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.529868    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 10:53:12.577725 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.577670    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r999n"]
Jul 17 10:53:12.589197 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.589171    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9zdmf"]
Jul 17 10:53:12.589304 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.589287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.592244 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.592225    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dnhpd\""
Jul 17 10:53:12.592647 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.592630    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 10:53:12.593071 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.593045    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 10:53:12.601297 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.601276    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r999n"]
Jul 17 10:53:12.601387 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.601367    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9zdmf"
Jul 17 10:53:12.601519 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.601495    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9zdmf"]
Jul 17 10:53:12.603945 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.603923    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-25nnq\""
Jul 17 10:53:12.604046 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.603983    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 10:53:12.604046 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.604039    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 10:53:12.604187 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.604056    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 10:53:12.674816 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.674787    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:12.674975 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.674880    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:12.674975 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.674907    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:12.677489 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.677465    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 10:53:12.677489 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.677478    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rk769\""
Jul 17 10:53:12.677489 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.677465    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 10:53:12.677693 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.677469    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 10:53:12.677693 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.677470    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gt9xr\""
Jul 17 10:53:12.677832 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.677817    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 10:53:12.715035 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.715014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:12.724948 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.724926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b648385-a42a-440a-b7ab-3246ec144bb5-tmp-dir\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.725046 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.724951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4jp\" (UniqueName: \"kubernetes.io/projected/7b648385-a42a-440a-b7ab-3246ec144bb5-kube-api-access-dw4jp\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.725046 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.724971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x97w8\" (UniqueName: \"kubernetes.io/projected/ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c-kube-api-access-x97w8\") pod \"ingress-canary-9zdmf\" (UID: \"ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c\") " pod="openshift-ingress-canary/ingress-canary-9zdmf"
Jul 17 10:53:12.725046 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.725039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b648385-a42a-440a-b7ab-3246ec144bb5-config-volume\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.725185 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.725113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.725185 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.725158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c-cert\") pod \"ingress-canary-9zdmf\" (UID: \"ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c\") " pod="openshift-ingress-canary/ingress-canary-9zdmf"
Jul 17 10:53:12.810650 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.810619    2562 generic.go:356] "Generic (PLEG): container finished" podID="475bd173-f49b-4583-a4ca-258543fe2ef9" containerID="04b31cd985dea3cf29a2c635f82abf5f55d237e1df0447ff66cdb2f4ef3fba51" exitCode=0
Jul 17 10:53:12.810772 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.810673    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" event={"ID":"475bd173-f49b-4583-a4ca-258543fe2ef9","Type":"ContainerDied","Data":"04b31cd985dea3cf29a2c635f82abf5f55d237e1df0447ff66cdb2f4ef3fba51"}
Jul 17 10:53:12.825373 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.825346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b648385-a42a-440a-b7ab-3246ec144bb5-tmp-dir\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.825471 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.825378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4jp\" (UniqueName: \"kubernetes.io/projected/7b648385-a42a-440a-b7ab-3246ec144bb5-kube-api-access-dw4jp\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.825471 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.825400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x97w8\" (UniqueName: \"kubernetes.io/projected/ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c-kube-api-access-x97w8\") pod \"ingress-canary-9zdmf\" (UID: \"ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c\") " pod="openshift-ingress-canary/ingress-canary-9zdmf"
Jul 17 10:53:12.825471 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.825424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b648385-a42a-440a-b7ab-3246ec144bb5-config-volume\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.825471 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.825465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.825666 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.825518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c-cert\") pod \"ingress-canary-9zdmf\" (UID: \"ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c\") " pod="openshift-ingress-canary/ingress-canary-9zdmf"
Jul 17 10:53:12.825666 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:12.825606    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:53:12.825762 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.825683    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b648385-a42a-440a-b7ab-3246ec144bb5-tmp-dir\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.825762 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:12.825716    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls podName:7b648385-a42a-440a-b7ab-3246ec144bb5 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:13.325694701 +0000 UTC m=+34.130720178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls") pod "dns-default-r999n" (UID: "7b648385-a42a-440a-b7ab-3246ec144bb5") : secret "dns-default-metrics-tls" not found
Jul 17 10:53:12.826007 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.825988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7b648385-a42a-440a-b7ab-3246ec144bb5-config-volume\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.829653 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.829607    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c-cert\") pod \"ingress-canary-9zdmf\" (UID: \"ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c\") " pod="openshift-ingress-canary/ingress-canary-9zdmf"
Jul 17 10:53:12.834142 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.834123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4jp\" (UniqueName: \"kubernetes.io/projected/7b648385-a42a-440a-b7ab-3246ec144bb5-kube-api-access-dw4jp\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:12.834312 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.834286    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x97w8\" (UniqueName: \"kubernetes.io/projected/ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c-kube-api-access-x97w8\") pod \"ingress-canary-9zdmf\" (UID: \"ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c\") " pod="openshift-ingress-canary/ingress-canary-9zdmf"
Jul 17 10:53:12.910354 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:12.910327    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9zdmf"
Jul 17 10:53:13.054393 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.054195    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9zdmf"]
Jul 17 10:53:13.057900 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:13.057876    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1309d4_ee58_4f0e_8fa0_cb139ca57d2c.slice/crio-5e2a2fda8fdd4af44e867908f74a1708d1e0dbc6774bac99e1496f978e084609 WatchSource:0}: Error finding container 5e2a2fda8fdd4af44e867908f74a1708d1e0dbc6774bac99e1496f978e084609: Status 404 returned error can't find the container with id 5e2a2fda8fdd4af44e867908f74a1708d1e0dbc6774bac99e1496f978e084609
Jul 17 10:53:13.329042 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.329010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:13.329042 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.329047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:13.329377 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:13.329179    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 17 10:53:13.329377 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:13.329189    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:53:13.329377 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:13.329232    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs podName:7a16b5bd-822c-46a6-b5d4-d1107c5a22eb nodeName:}" failed. No retries permitted until 2026-07-17 10:53:45.329217704 +0000 UTC m=+66.134243168 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs") pod "network-metrics-daemon-9x24l" (UID: "7a16b5bd-822c-46a6-b5d4-d1107c5a22eb") : secret "metrics-daemon-secret" not found
Jul 17 10:53:13.329377 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:13.329247    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls podName:7b648385-a42a-440a-b7ab-3246ec144bb5 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:14.329239754 +0000 UTC m=+35.134265217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls") pod "dns-default-r999n" (UID: "7b648385-a42a-440a-b7ab-3246ec144bb5") : secret "dns-default-metrics-tls" not found
Jul 17 10:53:13.429742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.429705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:13.429961 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.429772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:13.432783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.432752    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9-original-pull-secret\") pod \"global-pull-secret-syncer-zlghh\" (UID: \"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9\") " pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:13.432898 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.432888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbkdr\" (UniqueName: \"kubernetes.io/projected/8b48f25d-3815-44f0-b302-cee524354a67-kube-api-access-tbkdr\") pod \"network-check-target-srht5\" (UID: \"8b48f25d-3815-44f0-b302-cee524354a67\") " pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:13.591772 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.591684    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:13.596832 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.596815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zlghh"
Jul 17 10:53:13.758546 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.758504    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-srht5"]
Jul 17 10:53:13.762068 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:13.762043    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b48f25d_3815_44f0_b302_cee524354a67.slice/crio-56daecb830dfa65bb2a6a8149819ab8c777b93c97ed148e327784ef8f9d36842 WatchSource:0}: Error finding container 56daecb830dfa65bb2a6a8149819ab8c777b93c97ed148e327784ef8f9d36842: Status 404 returned error can't find the container with id 56daecb830dfa65bb2a6a8149819ab8c777b93c97ed148e327784ef8f9d36842
Jul 17 10:53:13.783705 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.783679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zlghh"]
Jul 17 10:53:13.786618 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:13.786595    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fcfdbb_219f_4e6a_b74b_001dfd0b2ac9.slice/crio-a18ebda8c7ac52c7270fe7baaefc58f6b3475d1682cbae7dd44f2ec352c8e89d WatchSource:0}: Error finding container a18ebda8c7ac52c7270fe7baaefc58f6b3475d1682cbae7dd44f2ec352c8e89d: Status 404 returned error can't find the container with id a18ebda8c7ac52c7270fe7baaefc58f6b3475d1682cbae7dd44f2ec352c8e89d
Jul 17 10:53:13.815880 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.815856    2562 generic.go:356] "Generic (PLEG): container finished" podID="475bd173-f49b-4583-a4ca-258543fe2ef9" containerID="4a5676eeb0c7ebab9b8070417fdf872b0a239ff60a68d6b2930f4679b98d58d1" exitCode=0
Jul 17 10:53:13.815998 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.815915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" event={"ID":"475bd173-f49b-4583-a4ca-258543fe2ef9","Type":"ContainerDied","Data":"4a5676eeb0c7ebab9b8070417fdf872b0a239ff60a68d6b2930f4679b98d58d1"}
Jul 17 10:53:13.817170 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.817147    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zlghh" event={"ID":"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9","Type":"ContainerStarted","Data":"a18ebda8c7ac52c7270fe7baaefc58f6b3475d1682cbae7dd44f2ec352c8e89d"}
Jul 17 10:53:13.818119 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.818100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srht5" event={"ID":"8b48f25d-3815-44f0-b302-cee524354a67","Type":"ContainerStarted","Data":"56daecb830dfa65bb2a6a8149819ab8c777b93c97ed148e327784ef8f9d36842"}
Jul 17 10:53:13.819410 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:13.819391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9zdmf" event={"ID":"ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c","Type":"ContainerStarted","Data":"5e2a2fda8fdd4af44e867908f74a1708d1e0dbc6774bac99e1496f978e084609"}
Jul 17 10:53:14.335576 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:14.335543    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:14.335745 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:14.335675    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:53:14.335745 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:14.335743    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls podName:7b648385-a42a-440a-b7ab-3246ec144bb5 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:16.335725537 +0000 UTC m=+37.140751005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls") pod "dns-default-r999n" (UID: "7b648385-a42a-440a-b7ab-3246ec144bb5") : secret "dns-default-metrics-tls" not found
Jul 17 10:53:14.827625 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:14.827584    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" event={"ID":"475bd173-f49b-4583-a4ca-258543fe2ef9","Type":"ContainerStarted","Data":"663cee706656b396db920fa19e6c18573c92ebef3682b181955c035323bf8f07"}
Jul 17 10:53:14.855204 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:14.854306    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rbjl7" podStartSLOduration=7.848259401 podStartE2EDuration="35.854286251s" totalImagesPullingTime="28.00602685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:14.853167229 +0000 UTC m=+35.658192714" watchObservedRunningTime="2026-07-17 10:53:14.854286251 +0000 UTC m=+35.659311737"
Jul 17 10:53:14.980172 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:14.980109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:15.047451 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.047421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:15.354777 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.354745    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549"]
Jul 17 10:53:15.388016 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.387986    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549"]
Jul 17 10:53:15.388016 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.388024    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7d856bb68d-fzsgp"]
Jul 17 10:53:15.388252 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.388124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549"
Jul 17 10:53:15.393059 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.392852    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wxqh5\""
Jul 17 10:53:15.393059 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.392930    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:53:15.393059 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.392947    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 17 10:53:15.403698 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.403680    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.406923 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.406830    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 10:53:15.407620 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.407591    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d856bb68d-fzsgp"]
Jul 17 10:53:15.410551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.408970    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 10:53:15.410551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.409207    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 10:53:15.410551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.409383    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ntstr\""
Jul 17 10:53:15.410551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.409557    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 10:53:15.410551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.409804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 10:53:15.410551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.409992    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 10:53:15.458552 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.458525    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"]
Jul 17 10:53:15.471949 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.471926    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.486167 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.486141    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 17 10:53:15.486369 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.486340    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:53:15.486437 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.486374    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 17 10:53:15.487423 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.487406    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 17 10:53:15.487665 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.487648    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fbcth\""
Jul 17 10:53:15.547218 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.546952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.547385 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.547249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.547385 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.547305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d300558-5661-4046-9a61-426b79e18bac-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.547385 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.547337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-default-certificate\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.547557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.547427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx68f\" (UniqueName: \"kubernetes.io/projected/c1a77a08-6c69-4e24-a666-f449f4da88d9-kube-api-access-sx68f\") pod \"volume-data-source-validator-78cf4c6f6-wh549\" (UID: \"c1a77a08-6c69-4e24-a666-f449f4da88d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549"
Jul 17 10:53:15.547557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.547463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d300558-5661-4046-9a61-426b79e18bac-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.547557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.547492    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-stats-auth\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.547557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.547523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lvkp\" (UniqueName: \"kubernetes.io/projected/4092b03a-662e-421e-9019-2df165983d93-kube-api-access-7lvkp\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.547748 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.547554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphn7\" (UniqueName: \"kubernetes.io/projected/8d300558-5661-4046-9a61-426b79e18bac-kube-api-access-hphn7\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.556027 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.555928    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"]
Jul 17 10:53:15.648119 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx68f\" (UniqueName: \"kubernetes.io/projected/c1a77a08-6c69-4e24-a666-f449f4da88d9-kube-api-access-sx68f\") pod \"volume-data-source-validator-78cf4c6f6-wh549\" (UID: \"c1a77a08-6c69-4e24-a666-f449f4da88d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549"
Jul 17 10:53:15.648119 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d300558-5661-4046-9a61-426b79e18bac-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.648375 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-stats-auth\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.648375 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lvkp\" (UniqueName: \"kubernetes.io/projected/4092b03a-662e-421e-9019-2df165983d93-kube-api-access-7lvkp\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.648375 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphn7\" (UniqueName: \"kubernetes.io/projected/8d300558-5661-4046-9a61-426b79e18bac-kube-api-access-hphn7\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.648375 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.648375 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.648375 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d300558-5661-4046-9a61-426b79e18bac-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.648375 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.648319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-default-certificate\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.648628 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:15.648446    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:53:15.648628 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:15.648496    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:16.148483075 +0000 UTC m=+36.953508538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : secret "router-metrics-certs-default" not found
Jul 17 10:53:15.648823 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:15.648806    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:16.148790357 +0000 UTC m=+36.953815840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : configmap references non-existent config key: service-ca.crt
Jul 17 10:53:15.649676 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.649467    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8d300558-5661-4046-9a61-426b79e18bac-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.653513 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.653454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-stats-auth\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.653513 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.653454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-default-certificate\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.655586 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.655535    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8d300558-5661-4046-9a61-426b79e18bac-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.660255 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.660232    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx68f\" (UniqueName: \"kubernetes.io/projected/c1a77a08-6c69-4e24-a666-f449f4da88d9-kube-api-access-sx68f\") pod \"volume-data-source-validator-78cf4c6f6-wh549\" (UID: \"c1a77a08-6c69-4e24-a666-f449f4da88d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549"
Jul 17 10:53:15.662745 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.662681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lvkp\" (UniqueName: \"kubernetes.io/projected/4092b03a-662e-421e-9019-2df165983d93-kube-api-access-7lvkp\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:15.663469 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.663443    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphn7\" (UniqueName: \"kubernetes.io/projected/8d300558-5661-4046-9a61-426b79e18bac-kube-api-access-hphn7\") pod \"kube-storage-version-migrator-operator-7658d9b749-4gkhz\" (UID: \"8d300558-5661-4046-9a61-426b79e18bac\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:15.669787 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.669662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:15.699736 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.699709    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549"
Jul 17 10:53:15.767388 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.767262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:15.782941 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:15.782905    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"
Jul 17 10:53:16.152445 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.152412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:16.152912 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.152458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:16.152912 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:16.152600    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:53:16.152912 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:16.152683    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:17.152659653 +0000 UTC m=+37.957685119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : secret "router-metrics-certs-default" not found
Jul 17 10:53:16.152912 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:16.152702    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:17.152692951 +0000 UTC m=+37.957718414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : configmap references non-existent config key: service-ca.crt
Jul 17 10:53:16.354487 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.354425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:16.354674 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:16.354604    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:53:16.354740 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:16.354682    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls podName:7b648385-a42a-440a-b7ab-3246ec144bb5 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:20.354661307 +0000 UTC m=+41.159686773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls") pod "dns-default-r999n" (UID: "7b648385-a42a-440a-b7ab-3246ec144bb5") : secret "dns-default-metrics-tls" not found
Jul 17 10:53:16.651819 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.651778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:16.712812 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.712775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:16.737402 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.737378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz"]
Jul 17 10:53:16.741958 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.741935    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549"]
Jul 17 10:53:16.812137 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:16.812100    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d300558_5661_4046_9a61_426b79e18bac.slice/crio-ef9573961e20403ffd42e1fe37035a788deb977e02a30de29c0162f6cda62d4a WatchSource:0}: Error finding container ef9573961e20403ffd42e1fe37035a788deb977e02a30de29c0162f6cda62d4a: Status 404 returned error can't find the container with id ef9573961e20403ffd42e1fe37035a788deb977e02a30de29c0162f6cda62d4a
Jul 17 10:53:16.813165 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:16.813066    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a77a08_6c69_4e24_a666_f449f4da88d9.slice/crio-abbbffab955ecef70f00d4e2a58dfbb33d672ac83eb0a188548e9465ee2e90f6 WatchSource:0}: Error finding container abbbffab955ecef70f00d4e2a58dfbb33d672ac83eb0a188548e9465ee2e90f6: Status 404 returned error can't find the container with id abbbffab955ecef70f00d4e2a58dfbb33d672ac83eb0a188548e9465ee2e90f6
Jul 17 10:53:16.835965 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.835932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549" event={"ID":"c1a77a08-6c69-4e24-a666-f449f4da88d9","Type":"ContainerStarted","Data":"abbbffab955ecef70f00d4e2a58dfbb33d672ac83eb0a188548e9465ee2e90f6"}
Jul 17 10:53:16.837225 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:16.837195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz" event={"ID":"8d300558-5661-4046-9a61-426b79e18bac","Type":"ContainerStarted","Data":"ef9573961e20403ffd42e1fe37035a788deb977e02a30de29c0162f6cda62d4a"}
Jul 17 10:53:17.162256 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:17.162225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:17.162256 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:17.162264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:17.163086 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:17.162410    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:53:17.163086 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:17.162476    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:19.162456694 +0000 UTC m=+39.967482159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : configmap references non-existent config key: service-ca.crt
Jul 17 10:53:17.163086 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:17.162508    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:19.162496483 +0000 UTC m=+39.967521946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : secret "router-metrics-certs-default" not found
Jul 17 10:53:18.323962 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:18.323918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:18.392675 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:18.392626    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:18.595206 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:18.595103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:18.696580 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:18.696546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:19.050783 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.050726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:19.181547 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.181506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:19.181743 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.181564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:19.181743 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:19.181668    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:53:19.181743 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:19.181724    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:23.181710447 +0000 UTC m=+43.986735910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : configmap references non-existent config key: service-ca.crt
Jul 17 10:53:19.181955 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:19.181753    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:23.181741183 +0000 UTC m=+43.986766648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : secret "router-metrics-certs-default" not found
Jul 17 10:53:19.183093 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.183056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:19.271856 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.271819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:19.847599 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.847564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-srht5" event={"ID":"8b48f25d-3815-44f0-b302-cee524354a67","Type":"ContainerStarted","Data":"7deb29c8ac4b079a1e6b43cca680d963f54a20ed82aee8dc1bce25ef74989c32"}
Jul 17 10:53:19.848322 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.848256    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:19.850602 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.850574    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9zdmf" event={"ID":"ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c","Type":"ContainerStarted","Data":"5c46900160281f176b658790ee08a9c436d71058c3ad4036848f53d65165756e"}
Jul 17 10:53:19.860668 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.860639    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hzcrj"]
Jul 17 10:53:19.876220 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.876196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:19.879703 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.877276    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-srht5" podStartSLOduration=34.977103138 podStartE2EDuration="40.877258074s" totalImagesPullingTime="5.900154936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:19.877160937 +0000 UTC m=+40.682186401" watchObservedRunningTime="2026-07-17 10:53:19.877258074 +0000 UTC m=+40.682283563"
Jul 17 10:53:19.879703 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.878951    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hzcrj"]
Jul 17 10:53:19.879703 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.879316    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 10:53:19.879703 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.879360    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x57x9\""
Jul 17 10:53:19.879703 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.879527    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 10:53:19.879703 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.879568    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 10:53:19.879703 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.879563    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 10:53:19.906469 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.906422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:19.925255 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.924773    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9zdmf" podStartSLOduration=1.363281946 podStartE2EDuration="7.924751959s" totalImagesPullingTime="6.561470013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:19.903072295 +0000 UTC m=+40.708097813" watchObservedRunningTime="2026-07-17 10:53:19.924751959 +0000 UTC m=+40.729777445"
Jul 17 10:53:19.988678 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.988191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzfz\" (UniqueName: \"kubernetes.io/projected/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-api-access-5hzfz\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:19.988678 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.988244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5fc8261-c3e3-4167-93cb-a2184dcc1604-data-volume\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:19.988678 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.988269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:19.988678 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.988300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5fc8261-c3e3-4167-93cb-a2184dcc1604-crio-socket\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:19.988678 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:19.988407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.089428 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.089396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.089610 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.089467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzfz\" (UniqueName: \"kubernetes.io/projected/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-api-access-5hzfz\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.089610 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.089492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5fc8261-c3e3-4167-93cb-a2184dcc1604-data-volume\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.089610 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.089513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.089610 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.089537    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:20.089786 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.089678    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:20.589655506 +0000 UTC m=+41.394680982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:20.089786 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.089746    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5fc8261-c3e3-4167-93cb-a2184dcc1604-crio-socket\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.089786 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.089541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c5fc8261-c3e3-4167-93cb-a2184dcc1604-crio-socket\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.089933 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.089898    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:20.089991 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.089960    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:20.589943705 +0000 UTC m=+41.394969186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:20.090157 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.090139    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5fc8261-c3e3-4167-93cb-a2184dcc1604-data-volume\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.100398 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.100315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzfz\" (UniqueName: \"kubernetes.io/projected/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-api-access-5hzfz\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.391543 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.391507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:20.391706 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.391625    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 10:53:20.391706 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.391692    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls podName:7b648385-a42a-440a-b7ab-3246ec144bb5 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:28.391675902 +0000 UTC m=+49.196701366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls") pod "dns-default-r999n" (UID: "7b648385-a42a-440a-b7ab-3246ec144bb5") : secret "dns-default-metrics-tls" not found
Jul 17 10:53:20.593815 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.593779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.593962 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.593923    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:20.593962 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.593953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:20.594041 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.593990    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:21.593972751 +0000 UTC m=+42.398998227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:20.594041 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.594016    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:20.594142 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:20.594059    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:21.594046352 +0000 UTC m=+42.399071818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:20.746983 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.746905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:20.855532 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.855497    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zlghh" event={"ID":"72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9","Type":"ContainerStarted","Data":"5e7d24aa0ba8501dfe3c1bf5924191c9ecc962428eb3fc3084ac765549fbb6a6"}
Jul 17 10:53:20.875919 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:20.875862    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zlghh" podStartSLOduration=35.982915875 podStartE2EDuration="41.875841206s" totalImagesPullingTime="5.892925331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:20.874936354 +0000 UTC m=+41.679961865" watchObservedRunningTime="2026-07-17 10:53:20.875841206 +0000 UTC m=+41.680866692"
Jul 17 10:53:21.602306 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:21.602219    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:21.602306 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:21.602295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:21.602537 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:21.602356    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:21.602537 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:21.602400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:21.602537 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:21.602432    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:23.602416622 +0000 UTC m=+44.407442088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:21.602537 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:21.602431    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:21.602537 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:21.602472    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:23.602462258 +0000 UTC m=+44.407487745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:21.854383 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:21.854309    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qr4cc_0286f029-cca9-4df3-a452-b11e80f99247/dns-node-resolver/0.log"
Jul 17 10:53:21.859510 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:21.859487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549" event={"ID":"c1a77a08-6c69-4e24-a666-f449f4da88d9","Type":"ContainerStarted","Data":"abdd350dccf08fc6cff21ec130d610b4715f9eeb3fe21b8d16b9eef311d826c7"}
Jul 17 10:53:21.860993 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:21.860966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz" event={"ID":"8d300558-5661-4046-9a61-426b79e18bac","Type":"ContainerStarted","Data":"a43c72451f9c8475231b122534012a6484a4be2ddc359eac68956283989151c7"}
Jul 17 10:53:21.878132 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:21.878067    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wh549" podStartSLOduration=2.416623695 podStartE2EDuration="6.878052401s" totalImagesPullingTime="4.461428706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:21.876473533 +0000 UTC m=+42.681499031" watchObservedRunningTime="2026-07-17 10:53:21.878052401 +0000 UTC m=+42.683077930"
Jul 17 10:53:21.898010 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:21.897970    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz" podStartSLOduration=2.105625228 podStartE2EDuration="6.897958195s" totalImagesPullingTime="4.792332967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:21.896681289 +0000 UTC m=+42.701706774" watchObservedRunningTime="2026-07-17 10:53:21.897958195 +0000 UTC m=+42.702983679"
Jul 17 10:53:22.661127 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:22.661054    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7hsm8_56c2b59f-ee0b-4bb6-904b-67cd4de9ea38/node-ca/0.log"
Jul 17 10:53:22.842062 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:22.842027    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:22.944219 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:22.944133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:23.047035 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.046995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:23.145170 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.145135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:23.214006 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.213936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:23.214006 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.213971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:23.214187 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:23.214102    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 10:53:23.214187 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:23.214157    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:31.214143661 +0000 UTC m=+52.019169124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : secret "router-metrics-certs-default" not found
Jul 17 10:53:23.214187 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:23.214173    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle podName:4092b03a-662e-421e-9019-2df165983d93 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:31.214165743 +0000 UTC m=+52.019191206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle") pod "router-default-7d856bb68d-fzsgp" (UID: "4092b03a-662e-421e-9019-2df165983d93") : configmap references non-existent config key: service-ca.crt
Jul 17 10:53:23.244388 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.244358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:23.364649 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.364618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:23.436132 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.436105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:23.453997 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.453970    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9zdmf_ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c/serve-healthcheck-canary/0.log"
Jul 17 10:53:23.557606 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.557531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:23.617530 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.617503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:23.617705 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.617560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:23.617705 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:23.617638    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:23.617705 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:23.617654    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:23.617705 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:23.617701    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:27.617688501 +0000 UTC m=+48.422713964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:23.617871 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:23.617715    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:27.617708615 +0000 UTC m=+48.422734078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:23.710482 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:23.710453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:24.386568 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:24.386528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:24.507231 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:24.507198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:24.938532 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:24.938499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:25.128160 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:25.128123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:25.506549 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:25.506513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:25.908151 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:25.908119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:26.509424 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:26.509389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:26.717680 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:26.717638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:26.915684 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:26.915652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:27.017283 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:27.017231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:27.310044 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:27.309957    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:27.649842 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:27.649812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:27.650223 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:27.649879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:27.650223 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:27.649953    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 10:53:27.650223 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:27.650026    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:35.650001959 +0000 UTC m=+56.455027422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : configmap "kube-rbac-proxy" not found
Jul 17 10:53:27.650223 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:27.649955    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:27.650223 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:27.650111    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls podName:c5fc8261-c3e3-4167-93cb-a2184dcc1604 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:35.650098512 +0000 UTC m=+56.455123976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hzcrj" (UID: "c5fc8261-c3e3-4167-93cb-a2184dcc1604") : secret "insights-runtime-extractor-tls" not found
Jul 17 10:53:27.707225 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:27.707180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:27.809870 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:27.809832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:27.909643 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:27.909549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:27.972478 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:27.972444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:28.455129 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:28.455068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:28.457311 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:28.457291    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7b648385-a42a-440a-b7ab-3246ec144bb5-metrics-tls\") pod \"dns-default-r999n\" (UID: \"7b648385-a42a-440a-b7ab-3246ec144bb5\") " pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:28.499195 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:28.499164    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:28.509890 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:28.509364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:28.630347 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:28.630316    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r999n"]
Jul 17 10:53:28.635029 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:28.634994    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b648385_a42a_440a_b7ab_3246ec144bb5.slice/crio-1657cf57746fa1e97bb4a410119d07120073c02103867e3a0a8d7a6d6fd87e1b WatchSource:0}: Error finding container 1657cf57746fa1e97bb4a410119d07120073c02103867e3a0a8d7a6d6fd87e1b: Status 404 returned error can't find the container with id 1657cf57746fa1e97bb4a410119d07120073c02103867e3a0a8d7a6d6fd87e1b
Jul 17 10:53:28.879683 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:28.879654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r999n" event={"ID":"7b648385-a42a-440a-b7ab-3246ec144bb5","Type":"ContainerStarted","Data":"1657cf57746fa1e97bb4a410119d07120073c02103867e3a0a8d7a6d6fd87e1b"}
Jul 17 10:53:28.910706 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:28.910671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:29.227810 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:29.227715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:29.328327 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:29.328242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:29.713153 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:29.713119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:30.113318 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:30.113285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:30.887046 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:30.887014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r999n" event={"ID":"7b648385-a42a-440a-b7ab-3246ec144bb5","Type":"ContainerStarted","Data":"94964267e2240fea42f2dfe31cb6d19f43e87a47101627a19f86e4e01e143bc2"}
Jul 17 10:53:30.887222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:30.887111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r999n" event={"ID":"7b648385-a42a-440a-b7ab-3246ec144bb5","Type":"ContainerStarted","Data":"f5025879c5c937703974af2cf546e68bef51c8d18ef846c04c7909c7b951ca40"}
Jul 17 10:53:30.887222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:30.887134    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:30.904264 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:30.904216    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r999n" podStartSLOduration=17.179455997 podStartE2EDuration="18.904201025s" totalImagesPullingTime="1.724745028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:30.904000118 +0000 UTC m=+51.709025604" watchObservedRunningTime="2026-07-17 10:53:30.904201025 +0000 UTC m=+51.709226511"
Jul 17 10:53:31.234531 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.234435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:31.276964 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.276935    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:31.276964 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.276966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:31.277567 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.277548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4092b03a-662e-421e-9019-2df165983d93-service-ca-bundle\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:31.279282 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.279262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4092b03a-662e-421e-9019-2df165983d93-metrics-certs\") pod \"router-default-7d856bb68d-fzsgp\" (UID: \"4092b03a-662e-421e-9019-2df165983d93\") " pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:31.300234 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.300207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:31.318029 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.318002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:31.356680 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.356650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:31.440516 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.440478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d856bb68d-fzsgp"]
Jul 17 10:53:31.444298 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:31.444271    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4092b03a_662e_421e_9019_2df165983d93.slice/crio-f2e5e592eb165b57d180865df5fc6a147d6af82d23bd8039c553ac725597f7c7 WatchSource:0}: Error finding container f2e5e592eb165b57d180865df5fc6a147d6af82d23bd8039c553ac725597f7c7: Status 404 returned error can't find the container with id f2e5e592eb165b57d180865df5fc6a147d6af82d23bd8039c553ac725597f7c7
Jul 17 10:53:31.510807 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.510781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:31.815385 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.815301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:31.892308 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.892272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d856bb68d-fzsgp" event={"ID":"4092b03a-662e-421e-9019-2df165983d93","Type":"ContainerStarted","Data":"040e3a6d125300f570fd228d1f22e72963c17f22d4759da8f190e87dd5882311"}
Jul 17 10:53:31.892440 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.892323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d856bb68d-fzsgp" event={"ID":"4092b03a-662e-421e-9019-2df165983d93","Type":"ContainerStarted","Data":"f2e5e592eb165b57d180865df5fc6a147d6af82d23bd8039c553ac725597f7c7"}
Jul 17 10:53:31.909665 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.909617    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7d856bb68d-fzsgp" podStartSLOduration=16.909604525 podStartE2EDuration="16.909604525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:31.909360575 +0000 UTC m=+52.714386060" watchObservedRunningTime="2026-07-17 10:53:31.909604525 +0000 UTC m=+52.714630009"
Jul 17 10:53:31.913951 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:31.913929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:32.318346 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:32.318313    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:32.320700 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:32.320682    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:32.508547 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:32.508511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:32.895232 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:32.895202    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:32.896387 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:32.896371    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7d856bb68d-fzsgp"
Jul 17 10:53:32.908010 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:32.907982    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:33.113166 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:33.113131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:33.518148 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:33.518115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:33.719840 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:33.719807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:33.825915 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:33.825845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:33.938851 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:33.938820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:34.180363 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:34.180337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:35.707769 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:35.707739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:35.708275 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:35.707789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:35.708402 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:35.708379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c5fc8261-c3e3-4167-93cb-a2184dcc1604-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:35.710028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:35.710011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c5fc8261-c3e3-4167-93cb-a2184dcc1604-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hzcrj\" (UID: \"c5fc8261-c3e3-4167-93cb-a2184dcc1604\") " pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:35.789537 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:35.789507    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hzcrj"
Jul 17 10:53:35.950336 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:35.950306    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hzcrj"]
Jul 17 10:53:35.954375 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:35.954349    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fc8261_c3e3_4167_93cb_a2184dcc1604.slice/crio-4257d47d234b5a285c6b1b42a9398d4b17f53a5fb96aee06af075a8fa8cf029f WatchSource:0}: Error finding container 4257d47d234b5a285c6b1b42a9398d4b17f53a5fb96aee06af075a8fa8cf029f: Status 404 returned error can't find the container with id 4257d47d234b5a285c6b1b42a9398d4b17f53a5fb96aee06af075a8fa8cf029f
Jul 17 10:53:36.910909 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:36.910846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzcrj" event={"ID":"c5fc8261-c3e3-4167-93cb-a2184dcc1604","Type":"ContainerStarted","Data":"4257d47d234b5a285c6b1b42a9398d4b17f53a5fb96aee06af075a8fa8cf029f"}
Jul 17 10:53:38.105723 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:38.105675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:38.211532 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:38.211499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:38.295064 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:38.295003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:38.413057 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:38.413018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:38.784508 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:38.784410    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:38.808665 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:38.808639    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j7gql"
Jul 17 10:53:38.881646 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:38.881607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:38.976489 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:38.976459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:39.063029 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:39.062955    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:39.181779 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:39.181743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:39.248180 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:39.248145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:39.981998 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:39.981962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:40.181817 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:40.181779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:40.871233 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:40.871194    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:40.894668 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:40.894639    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r999n"
Jul 17 10:53:40.926279 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:40.926248    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzcrj" event={"ID":"c5fc8261-c3e3-4167-93cb-a2184dcc1604","Type":"ContainerStarted","Data":"a7d613e2878f24417b4ec4eeb966348066b7ce68105f4df9503007fad0cc5dd5"}
Jul 17 10:53:41.212831 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.212773    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:41.311335 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.311293    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:41.980937 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.980108    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"]
Jul 17 10:53:41.984199 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.984174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"
Jul 17 10:53:41.989066 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.989026    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-km4lw\""
Jul 17 10:53:41.989218 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.989125    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 17 10:53:41.989355 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.989334    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 10:53:41.990787 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.990678    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 10:53:41.990989 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:41.990972    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 10:53:42.000242 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.000217    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"]
Jul 17 10:53:42.046312 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.045931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbvgn\" (UniqueName: \"kubernetes.io/projected/83eda124-9454-4cf1-b697-6af5080b63aa-kube-api-access-qbvgn\") pod \"managed-serviceaccount-addon-agent-bb6564c48-s64js\" (UID: \"83eda124-9454-4cf1-b697-6af5080b63aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"
Jul 17 10:53:42.046312 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.045978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83eda124-9454-4cf1-b697-6af5080b63aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bb6564c48-s64js\" (UID: \"83eda124-9454-4cf1-b697-6af5080b63aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"
Jul 17 10:53:42.079820 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.079784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:42.112921 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.112868    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-6n64x"]
Jul 17 10:53:42.126342 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.126304    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"]
Jul 17 10:53:42.126510 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.126441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6n64x"
Jul 17 10:53:42.132810 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.132783    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 17 10:53:42.132954 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.132817    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 17 10:53:42.133419 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.133396    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mpjxq\""
Jul 17 10:53:42.147108 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.147061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjk2\" (UniqueName: \"kubernetes.io/projected/b7a699db-cf90-4f66-b2dc-439565f827af-kube-api-access-4gjk2\") pod \"downloads-5bc67dcd46-6n64x\" (UID: \"b7a699db-cf90-4f66-b2dc-439565f827af\") " pod="openshift-console/downloads-5bc67dcd46-6n64x"
Jul 17 10:53:42.147235 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.147145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbvgn\" (UniqueName: \"kubernetes.io/projected/83eda124-9454-4cf1-b697-6af5080b63aa-kube-api-access-qbvgn\") pod \"managed-serviceaccount-addon-agent-bb6564c48-s64js\" (UID: \"83eda124-9454-4cf1-b697-6af5080b63aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"
Jul 17 10:53:42.147235 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.147174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83eda124-9454-4cf1-b697-6af5080b63aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bb6564c48-s64js\" (UID: \"83eda124-9454-4cf1-b697-6af5080b63aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"
Jul 17 10:53:42.148308 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.148287    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p"]
Jul 17 10:53:42.148440 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.148423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"
Jul 17 10:53:42.149748 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.149728    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/83eda124-9454-4cf1-b697-6af5080b63aa-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bb6564c48-s64js\" (UID: \"83eda124-9454-4cf1-b697-6af5080b63aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"
Jul 17 10:53:42.165168 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.165149    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fmwh8\""
Jul 17 10:53:42.165168 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.165161    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 17 10:53:42.172648 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.172629    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6n64x"]
Jul 17 10:53:42.172742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.172659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p"]
Jul 17 10:53:42.172742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.172679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"]
Jul 17 10:53:42.172742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.172738    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p"
Jul 17 10:53:42.193766 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.193736    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 17 10:53:42.197025 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.197002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbvgn\" (UniqueName: \"kubernetes.io/projected/83eda124-9454-4cf1-b697-6af5080b63aa-kube-api-access-qbvgn\") pod \"managed-serviceaccount-addon-agent-bb6564c48-s64js\" (UID: \"83eda124-9454-4cf1-b697-6af5080b63aa\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"
Jul 17 10:53:42.211511 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.211484    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 17 10:53:42.211632 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.211531    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 17 10:53:42.211928 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.211914    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9zdbz\""
Jul 17 10:53:42.248112 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.248009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5b4hs\" (UID: \"45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"
Jul 17 10:53:42.248112 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.248050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqtrr\" (UniqueName: \"kubernetes.io/projected/4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d-kube-api-access-jqtrr\") pod \"migrator-7cc9c7ffd7-7sf9p\" (UID: \"4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p"
Jul 17 10:53:42.248112 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.248101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5b4hs\" (UID: \"45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"
Jul 17 10:53:42.248610 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.248146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjk2\" (UniqueName: \"kubernetes.io/projected/b7a699db-cf90-4f66-b2dc-439565f827af-kube-api-access-4gjk2\") pod \"downloads-5bc67dcd46-6n64x\" (UID: \"b7a699db-cf90-4f66-b2dc-439565f827af\") " pod="openshift-console/downloads-5bc67dcd46-6n64x"
Jul 17 10:53:42.271148 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.271112    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjk2\" (UniqueName: \"kubernetes.io/projected/b7a699db-cf90-4f66-b2dc-439565f827af-kube-api-access-4gjk2\") pod \"downloads-5bc67dcd46-6n64x\" (UID: \"b7a699db-cf90-4f66-b2dc-439565f827af\") " pod="openshift-console/downloads-5bc67dcd46-6n64x"
Jul 17 10:53:42.285127 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.285097    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c6498b876-vhstv"]
Jul 17 10:53:42.302502 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.302472    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"
Jul 17 10:53:42.328106 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.328058    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6498b876-vhstv"]
Jul 17 10:53:42.328266 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.328186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.333436 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.333412    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 10:53:42.333881 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.333715    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 10:53:42.333881 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.333741    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 10:53:42.334052 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.333970    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcsz5\""
Jul 17 10:53:42.341660 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.341636    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 10:53:42.348995 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.348966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc995f87-1c7a-4aa7-a680-683b9cace3e1-image-registry-private-configuration\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.349106 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5b4hs\" (UID: \"45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"
Jul 17 10:53:42.349106 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-registry-tls\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.349196 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc995f87-1c7a-4aa7-a680-683b9cace3e1-installation-pull-secrets\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.349196 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349158    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5b4hs\" (UID: \"45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"
Jul 17 10:53:42.349196 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqtrr\" (UniqueName: \"kubernetes.io/projected/4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d-kube-api-access-jqtrr\") pod \"migrator-7cc9c7ffd7-7sf9p\" (UID: \"4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p"
Jul 17 10:53:42.349339 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc995f87-1c7a-4aa7-a680-683b9cace3e1-ca-trust-extracted\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.349339 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bj92\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-kube-api-access-7bj92\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.349339 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc995f87-1c7a-4aa7-a680-683b9cace3e1-trusted-ca\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.349487 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc995f87-1c7a-4aa7-a680-683b9cace3e1-registry-certificates\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.349487 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-bound-sa-token\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.349728 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.349707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-5b4hs\" (UID: \"45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"
Jul 17 10:53:42.351672 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.351648    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-5b4hs\" (UID: \"45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"
Jul 17 10:53:42.360620 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.360593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:42.368528 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.368500    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqtrr\" (UniqueName: \"kubernetes.io/projected/4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d-kube-api-access-jqtrr\") pod \"migrator-7cc9c7ffd7-7sf9p\" (UID: \"4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p"
Jul 17 10:53:42.438096 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.438040    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-6n64x"
Jul 17 10:53:42.450477 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.450437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bj92\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-kube-api-access-7bj92\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.450712 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.450493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc995f87-1c7a-4aa7-a680-683b9cace3e1-trusted-ca\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.450712 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.450531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc995f87-1c7a-4aa7-a680-683b9cace3e1-registry-certificates\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.450712 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.450555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-bound-sa-token\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.450712 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.450640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc995f87-1c7a-4aa7-a680-683b9cace3e1-image-registry-private-configuration\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.452028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.451357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-registry-tls\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.452028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.451440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc995f87-1c7a-4aa7-a680-683b9cace3e1-installation-pull-secrets\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.452028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.451514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc995f87-1c7a-4aa7-a680-683b9cace3e1-ca-trust-extracted\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.452028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.451904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc995f87-1c7a-4aa7-a680-683b9cace3e1-ca-trust-extracted\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.452028 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.451912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc995f87-1c7a-4aa7-a680-683b9cace3e1-trusted-ca\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.455040 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.454056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc995f87-1c7a-4aa7-a680-683b9cace3e1-registry-certificates\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.455040 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.455013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc995f87-1c7a-4aa7-a680-683b9cace3e1-image-registry-private-configuration\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.455277 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.455258    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc995f87-1c7a-4aa7-a680-683b9cace3e1-installation-pull-secrets\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.456507 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.456389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:42.457165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.457140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-registry-tls\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.460284 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.460263    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-bound-sa-token\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.460436 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.460410    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bj92\" (UniqueName: \"kubernetes.io/projected/fc995f87-1c7a-4aa7-a680-683b9cace3e1-kube-api-access-7bj92\") pod \"image-registry-7c6498b876-vhstv\" (UID: \"fc995f87-1c7a-4aa7-a680-683b9cace3e1\") " pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:42.461539 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.461519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"
Jul 17 10:53:42.480761 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.480730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p"
Jul 17 10:53:42.639415 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:42.639378    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:44.473652 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.473615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs"]
Jul 17 10:53:44.482961 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:44.482785    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c2ff42_0514_40fd_a7fc_c8c1d5bf6e8d.slice/crio-164fc4950a699e944e9cb4559cc5f09e01639699ca5aac152e14f8e126d2f2fc WatchSource:0}: Error finding container 164fc4950a699e944e9cb4559cc5f09e01639699ca5aac152e14f8e126d2f2fc: Status 404 returned error can't find the container with id 164fc4950a699e944e9cb4559cc5f09e01639699ca5aac152e14f8e126d2f2fc
Jul 17 10:53:44.609529 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.607786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p"]
Jul 17 10:53:44.612499 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:44.612450    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f89c1ff_2d49_437a_9d7d_2e5de8f1d88d.slice/crio-fc130389010efd355a86b410920102f5b3fcfcc3bb0e9fb5c22f56eb3c1dacef WatchSource:0}: Error finding container fc130389010efd355a86b410920102f5b3fcfcc3bb0e9fb5c22f56eb3c1dacef: Status 404 returned error can't find the container with id fc130389010efd355a86b410920102f5b3fcfcc3bb0e9fb5c22f56eb3c1dacef
Jul 17 10:53:44.632697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.632666    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js"]
Jul 17 10:53:44.635555 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:44.635528    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83eda124_9454_4cf1_b697_6af5080b63aa.slice/crio-5563a14d6d675caa3d4de4514c18aa2b93f657eebfcbae95b84fcc1a99dffcc6 WatchSource:0}: Error finding container 5563a14d6d675caa3d4de4514c18aa2b93f657eebfcbae95b84fcc1a99dffcc6: Status 404 returned error can't find the container with id 5563a14d6d675caa3d4de4514c18aa2b93f657eebfcbae95b84fcc1a99dffcc6
Jul 17 10:53:44.638165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.637998    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c6498b876-vhstv"]
Jul 17 10:53:44.641221 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:44.641201    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc995f87_1c7a_4aa7_a680_683b9cace3e1.slice/crio-b5a6f42e9aa6119de49fdf7426aec9314726c3cea9123c19ed2345829a258cf7 WatchSource:0}: Error finding container b5a6f42e9aa6119de49fdf7426aec9314726c3cea9123c19ed2345829a258cf7: Status 404 returned error can't find the container with id b5a6f42e9aa6119de49fdf7426aec9314726c3cea9123c19ed2345829a258cf7
Jul 17 10:53:44.658372 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.658345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-6n64x"]
Jul 17 10:53:44.672216 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:44.672191    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a699db_cf90_4f66_b2dc_439565f827af.slice/crio-deea37f2474e17268c6debc27798ce2f3e7058ff971fffb0fe7b9f8355cbc5a7 WatchSource:0}: Error finding container deea37f2474e17268c6debc27798ce2f3e7058ff971fffb0fe7b9f8355cbc5a7: Status 404 returned error can't find the container with id deea37f2474e17268c6debc27798ce2f3e7058ff971fffb0fe7b9f8355cbc5a7
Jul 17 10:53:44.941026 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.940987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p" event={"ID":"4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d","Type":"ContainerStarted","Data":"fc130389010efd355a86b410920102f5b3fcfcc3bb0e9fb5c22f56eb3c1dacef"}
Jul 17 10:53:44.942123 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.942097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6n64x" event={"ID":"b7a699db-cf90-4f66-b2dc-439565f827af","Type":"ContainerStarted","Data":"deea37f2474e17268c6debc27798ce2f3e7058ff971fffb0fe7b9f8355cbc5a7"}
Jul 17 10:53:44.943605 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.943579    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6498b876-vhstv" event={"ID":"fc995f87-1c7a-4aa7-a680-683b9cace3e1","Type":"ContainerStarted","Data":"8b22345f08cb853155135a5ca643695da3dea0f3eba33fa39336d6bb344378a8"}
Jul 17 10:53:44.943715 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.943615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c6498b876-vhstv" event={"ID":"fc995f87-1c7a-4aa7-a680-683b9cace3e1","Type":"ContainerStarted","Data":"b5a6f42e9aa6119de49fdf7426aec9314726c3cea9123c19ed2345829a258cf7"}
Jul 17 10:53:44.943715 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.943654    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:53:44.945299 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.945280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzcrj" event={"ID":"c5fc8261-c3e3-4167-93cb-a2184dcc1604","Type":"ContainerStarted","Data":"11b7e4ee57536bf4832d186621696783e4fd8cc33811aff84fbc975cbb607945"}
Jul 17 10:53:44.946326 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.946306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs" event={"ID":"45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d","Type":"ContainerStarted","Data":"164fc4950a699e944e9cb4559cc5f09e01639699ca5aac152e14f8e126d2f2fc"}
Jul 17 10:53:44.947443 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.947422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js" event={"ID":"83eda124-9454-4cf1-b697-6af5080b63aa","Type":"ContainerStarted","Data":"5563a14d6d675caa3d4de4514c18aa2b93f657eebfcbae95b84fcc1a99dffcc6"}
Jul 17 10:53:44.963328 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:44.963286    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c6498b876-vhstv" podStartSLOduration=2.963273478 podStartE2EDuration="2.963273478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:44.963033246 +0000 UTC m=+65.768058744" watchObservedRunningTime="2026-07-17 10:53:44.963273478 +0000 UTC m=+65.768298941"
Jul 17 10:53:45.375429 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:45.374949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:45.379751 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:45.379693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a16b5bd-822c-46a6-b5d4-d1107c5a22eb-metrics-certs\") pod \"network-metrics-daemon-9x24l\" (UID: \"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb\") " pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:45.389103 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:45.388932    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rk769\""
Jul 17 10:53:45.397222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:45.397196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9x24l"
Jul 17 10:53:45.453215 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:45.453180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:45.511901 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:45.511823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:46.286056 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:46.286029    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9x24l"]
Jul 17 10:53:46.298311 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:46.298282    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a16b5bd_822c_46a6_b5d4_d1107c5a22eb.slice/crio-3a6ec9fc1ec6b1304c91e13a4f22c8d693c6068020f99f6af6da73b73ac8be97 WatchSource:0}: Error finding container 3a6ec9fc1ec6b1304c91e13a4f22c8d693c6068020f99f6af6da73b73ac8be97: Status 404 returned error can't find the container with id 3a6ec9fc1ec6b1304c91e13a4f22c8d693c6068020f99f6af6da73b73ac8be97
Jul 17 10:53:46.960148 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:46.959474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs" event={"ID":"45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d","Type":"ContainerStarted","Data":"bd20e2fd327b8846f8a835ead4bbac62bb0cbc5c4bf68e6fda12d6ea0295f304"}
Jul 17 10:53:46.962164 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:46.962061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9x24l" event={"ID":"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb","Type":"ContainerStarted","Data":"3a6ec9fc1ec6b1304c91e13a4f22c8d693c6068020f99f6af6da73b73ac8be97"}
Jul 17 10:53:46.966155 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:46.965843    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p" event={"ID":"4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d","Type":"ContainerStarted","Data":"fd8b15ea133579f9dc3cd590b30429c40d73f285e347518e670473dcf00f5d66"}
Jul 17 10:53:46.966155 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:46.965893    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p" event={"ID":"4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d","Type":"ContainerStarted","Data":"6e63e4e86c21c2acb54a2ae87af7f1e36a7f059efe159dd3cf06c70c3f98d293"}
Jul 17 10:53:46.990564 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:46.990338    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-5b4hs" podStartSLOduration=3.353759987 podStartE2EDuration="4.99031834s" totalImagesPullingTime="1.636558353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:46.987968759 +0000 UTC m=+67.792994270" watchObservedRunningTime="2026-07-17 10:53:46.99031834 +0000 UTC m=+67.795343825"
Jul 17 10:53:47.051984 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:47.051951    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:47.213745 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:47.213666    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:47.313009 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:47.312971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:47.415646 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:47.415612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:49.808929 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:49.808887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:50.442443 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:50.442386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:50.858669 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:50.858643    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-srht5"
Jul 17 10:53:50.877552 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:50.877468    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-7sf9p" podStartSLOduration=7.365876336 podStartE2EDuration="8.877447172s" totalImagesPullingTime="1.511570836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:47.012052046 +0000 UTC m=+67.817077534" watchObservedRunningTime="2026-07-17 10:53:50.877447172 +0000 UTC m=+71.682472658"
Jul 17 10:53:51.512856 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:51.512817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:51.632012 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:51.631974    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:51.989722 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:51.989687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hzcrj" event={"ID":"c5fc8261-c3e3-4167-93cb-a2184dcc1604","Type":"ContainerStarted","Data":"13ddff3bdfb304af3ae2207f9ca105d60fda8f7a2435c83376b299506ca4d4a8"}
Jul 17 10:53:51.991730 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:51.991703    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9x24l" event={"ID":"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb","Type":"ContainerStarted","Data":"6479b0d6aa4d20078b08fe551d5a95b42160127da8bfe36f211df5d43222e8a8"}
Jul 17 10:53:51.991878 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:51.991758    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9x24l" event={"ID":"7a16b5bd-822c-46a6-b5d4-d1107c5a22eb","Type":"ContainerStarted","Data":"18a71c69ebaa6eb400e44954bca970fa45a9fdd7fd897f102d4e5c0eff2d2ccc"}
Jul 17 10:53:51.993263 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:51.993241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js" event={"ID":"83eda124-9454-4cf1-b697-6af5080b63aa","Type":"ContainerStarted","Data":"486d2108a1a5263ca47b597a5867e87e956c52e73b110c6b7c2b2f1aabb2b4ad"}
Jul 17 10:53:52.009699 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:52.009657    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hzcrj" podStartSLOduration=17.913135574000002 podStartE2EDuration="33.009644728s" totalImagesPullingTime="15.096509154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:53:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:52.008672673 +0000 UTC m=+72.813698183" watchObservedRunningTime="2026-07-17 10:53:52.009644728 +0000 UTC m=+72.814670212"
Jul 17 10:53:52.024551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:52.024508    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9x24l" podStartSLOduration=68.082164376 podStartE2EDuration="1m13.024494496s" totalImagesPullingTime="4.94233012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:52.024057237 +0000 UTC m=+72.829082722" watchObservedRunningTime="2026-07-17 10:53:52.024494496 +0000 UTC m=+72.829519980"
Jul 17 10:53:52.041708 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:52.041655    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bb6564c48-s64js" podStartSLOduration=4.427816255 podStartE2EDuration="11.041639043s" totalImagesPullingTime="6.613822788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:53:52.041194284 +0000 UTC m=+72.846219771" watchObservedRunningTime="2026-07-17 10:53:52.041639043 +0000 UTC m=+72.846664530"
Jul 17 10:53:52.126735 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:52.126699    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:52.227341 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:52.227307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:53.144700 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.144654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:53.357515 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.357467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:53.405311 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.405243    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"]
Jul 17 10:53:53.430968 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.430938    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ng2jw"]
Jul 17 10:53:53.431145 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.431065    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.434818 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.434797    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 10:53:53.435770 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.435747    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 10:53:53.435895 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.435791    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 17 10:53:53.442260 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.442240    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zq79q\""
Jul 17 10:53:53.443026 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.443010    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 10:53:53.443141 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.443059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 17 10:53:53.444855 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.444839    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"]
Jul 17 10:53:53.444974 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.444960    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.447516 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.447495    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 10:53:53.447977 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.447906    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sfnqc\""
Jul 17 10:53:53.447977 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.447925    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 10:53:53.448989 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.448971    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 10:53:53.463101 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.463058    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"]
Jul 17 10:53:53.463215 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.463128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"]
Jul 17 10:53:53.463275 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.463228    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.466010 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.465987    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 17 10:53:53.466010 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.466001    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 17 10:53:53.466807 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.466786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8b55k\""
Jul 17 10:53:53.466927 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.466827    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 17 10:53:53.513466 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.513434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:53.543426 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13c835de-51e0-49db-b385-450d506822c3-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.543594 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x6m4\" (UniqueName: \"kubernetes.io/projected/7812efd6-a9a7-45e4-808b-8e015b74a664-kube-api-access-4x6m4\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.543594 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-wtmp\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.543594 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-root\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.543761 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-textfile\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.543761 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-tls\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.543761 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.543761 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.543761 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.544037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543789    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/13c835de-51e0-49db-b385-450d506822c3-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.544037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.544037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b142691-4915-4797-9311-7d7f6d7f360f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.544037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn2jr\" (UniqueName: \"kubernetes.io/projected/8b142691-4915-4797-9311-7d7f6d7f360f-kube-api-access-wn2jr\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.544037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-accelerators-collector-config\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.544037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdlgx\" (UniqueName: \"kubernetes.io/projected/13c835de-51e0-49db-b385-450d506822c3-kube-api-access-cdlgx\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.544037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.543999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7812efd6-a9a7-45e4-808b-8e015b74a664-metrics-client-ca\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.544037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.544028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.544403 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.544053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-sys\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.544403 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.544071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.597313 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.597263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:53.645490 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.645456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.645684 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.645496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.645684 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.645633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/13c835de-51e0-49db-b385-450d506822c3-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.645779 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.645687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.645779 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.645716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b142691-4915-4797-9311-7d7f6d7f360f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.645779 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.645745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn2jr\" (UniqueName: \"kubernetes.io/projected/8b142691-4915-4797-9311-7d7f6d7f360f-kube-api-access-wn2jr\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.645924 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:53.645856    2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 17 10:53:53.645969 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:53.645940    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-tls podName:8b142691-4915-4797-9311-7d7f6d7f360f nodeName:}" failed. No retries permitted until 2026-07-17 10:53:54.14591776 +0000 UTC m=+74.950943227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-wvbfv" (UID: "8b142691-4915-4797-9311-7d7f6d7f360f") : secret "openshift-state-metrics-tls" not found
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/13c835de-51e0-49db-b385-450d506822c3-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-accelerators-collector-config\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdlgx\" (UniqueName: \"kubernetes.io/projected/13c835de-51e0-49db-b385-450d506822c3-kube-api-access-cdlgx\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7812efd6-a9a7-45e4-808b-8e015b74a664-metrics-client-ca\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646255    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-sys\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13c835de-51e0-49db-b385-450d506822c3-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x6m4\" (UniqueName: \"kubernetes.io/projected/7812efd6-a9a7-45e4-808b-8e015b74a664-kube-api-access-4x6m4\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-wtmp\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646459    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-sys\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-root\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646543    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-wtmp\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-textfile\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-tls\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.647623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b142691-4915-4797-9311-7d7f6d7f360f-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-accelerators-collector-config\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.646888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7812efd6-a9a7-45e4-808b-8e015b74a664-root\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.647253    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-textfile\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:53.647340    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:53.647390    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-tls podName:7812efd6-a9a7-45e4-808b-8e015b74a664 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:54.147373115 +0000 UTC m=+74.952398578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-tls") pod "node-exporter-ng2jw" (UID: "7812efd6-a9a7-45e4-808b-8e015b74a664") : secret "node-exporter-tls" not found
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.647423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13c835de-51e0-49db-b385-450d506822c3-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.647456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7812efd6-a9a7-45e4-808b-8e015b74a664-metrics-client-ca\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.648500 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.647574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.648862 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.648588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.648862 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.648687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/13c835de-51e0-49db-b385-450d506822c3-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.649172 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.649150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.649527 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.649508    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.665278 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.665173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x6m4\" (UniqueName: \"kubernetes.io/projected/7812efd6-a9a7-45e4-808b-8e015b74a664-kube-api-access-4x6m4\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:53.665437 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.665357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdlgx\" (UniqueName: \"kubernetes.io/projected/13c835de-51e0-49db-b385-450d506822c3-kube-api-access-cdlgx\") pod \"kube-state-metrics-56c5594674-gdhrq\" (UID: \"13c835de-51e0-49db-b385-450d506822c3\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.666202 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.666178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn2jr\" (UniqueName: \"kubernetes.io/projected/8b142691-4915-4797-9311-7d7f6d7f360f-kube-api-access-wn2jr\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:53.697273 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.697240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:53.774762 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.774729    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"
Jul 17 10:53:53.797567 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.797532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:53.898976 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.898910    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:53.951063 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:53.950983    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-gdhrq"]
Jul 17 10:53:53.954903 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:53.954876    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c835de_51e0_49db_b385_450d506822c3.slice/crio-c8d51e93d986ff9043e5f205c8ef2f5bb8497fc8bfd471e412e9bc8df0c0e4e0 WatchSource:0}: Error finding container c8d51e93d986ff9043e5f205c8ef2f5bb8497fc8bfd471e412e9bc8df0c0e4e0: Status 404 returned error can't find the container with id c8d51e93d986ff9043e5f205c8ef2f5bb8497fc8bfd471e412e9bc8df0c0e4e0
Jul 17 10:53:54.002469 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.002425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq" event={"ID":"13c835de-51e0-49db-b385-450d506822c3","Type":"ContainerStarted","Data":"c8d51e93d986ff9043e5f205c8ef2f5bb8497fc8bfd471e412e9bc8df0c0e4e0"}
Jul 17 10:53:54.010776 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.010747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:54.150242 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.150209    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-tls\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:54.150691 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.150358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:54.152864 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.152839    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7812efd6-a9a7-45e4-808b-8e015b74a664-node-exporter-tls\") pod \"node-exporter-ng2jw\" (UID: \"7812efd6-a9a7-45e4-808b-8e015b74a664\") " pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:54.152997 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.152935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b142691-4915-4797-9311-7d7f6d7f360f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wvbfv\" (UID: \"8b142691-4915-4797-9311-7d7f6d7f360f\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:54.342036 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.341957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"
Jul 17 10:53:54.357286 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.357259    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ng2jw"
Jul 17 10:53:54.405203 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:54.405175    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7812efd6_a9a7_45e4_808b_8e015b74a664.slice/crio-a790bebae2d291e016dae73bddb2f532effe2a4217fa490011fc9177e7c6e0af WatchSource:0}: Error finding container a790bebae2d291e016dae73bddb2f532effe2a4217fa490011fc9177e7c6e0af: Status 404 returned error can't find the container with id a790bebae2d291e016dae73bddb2f532effe2a4217fa490011fc9177e7c6e0af
Jul 17 10:53:54.468984 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.468839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:54.517864 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.517805    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv"]
Jul 17 10:53:54.520521 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:53:54.520489    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b142691_4915_4797_9311_7d7f6d7f360f.slice/crio-89567a1fc61298e96a91f94c9b884a9df4b4cde61aea685761abe350ffbcbc13 WatchSource:0}: Error finding container 89567a1fc61298e96a91f94c9b884a9df4b4cde61aea685761abe350ffbcbc13: Status 404 returned error can't find the container with id 89567a1fc61298e96a91f94c9b884a9df4b4cde61aea685761abe350ffbcbc13
Jul 17 10:53:54.554696 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.554664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:54.560504 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.560482    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:53:54.583907 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.583837    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:53:54.584035 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.584021    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.586701 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.586675    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 10:53:54.587088 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.587054    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-klrdl\""
Jul 17 10:53:54.587186 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.587106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 10:53:54.587354 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.587338    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 10:53:54.588867 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.588743    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 10:53:54.588867 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.588757    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 10:53:54.588867 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.588774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 10:53:54.589104 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.588871    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 10:53:54.589104 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.589021    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 10:53:54.589271 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.589252    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 10:53:54.654468 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654468 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654663 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654529    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654663 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654663 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654638    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-out\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654807 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654667    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-web-config\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654807 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654807 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654807 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dff9\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-kube-api-access-6dff9\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654996 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654996 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654996 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.654996 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.654924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.673508 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.673482    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:54.756241 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756406 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756406 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756406 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756406 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756406 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756406 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-out\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-web-config\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dff9\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-kube-api-access-6dff9\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.756697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.756599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.757196 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.757050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.757196 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:53:54.757145    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle podName:7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304 nodeName:}" failed. No retries permitted until 2026-07-17 10:53:55.257121105 +0000 UTC m=+76.062146572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304") : configmap references non-existent config key: ca-bundle.crt
Jul 17 10:53:54.759474 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.759105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.759474 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.759365    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.759474 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.759435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.760892 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.760868    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-web-config\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.760993 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.760969    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.761108 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.761069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-out\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.761339 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.761315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.761747 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.761727    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-volume\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.761823 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.761730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.762070 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.762050    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:54.767270 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:54.767246    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dff9\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-kube-api-access-6dff9\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:55.010846 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:55.010796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ng2jw" event={"ID":"7812efd6-a9a7-45e4-808b-8e015b74a664","Type":"ContainerStarted","Data":"a790bebae2d291e016dae73bddb2f532effe2a4217fa490011fc9177e7c6e0af"}
Jul 17 10:53:55.013051 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:55.013018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv" event={"ID":"8b142691-4915-4797-9311-7d7f6d7f360f","Type":"ContainerStarted","Data":"57f07135e854c372dbe83d2e30ae936f2a490ad7518d45c4afc95c26214a7840"}
Jul 17 10:53:55.013198 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:55.013100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv" event={"ID":"8b142691-4915-4797-9311-7d7f6d7f360f","Type":"ContainerStarted","Data":"ff04afcc37be5a685ad72efcd465ba6eb46163ce4e2ac53fdb522be023edb4ef"}
Jul 17 10:53:55.013198 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:55.013130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv" event={"ID":"8b142691-4915-4797-9311-7d7f6d7f360f","Type":"ContainerStarted","Data":"89567a1fc61298e96a91f94c9b884a9df4b4cde61aea685761abe350ffbcbc13"}
Jul 17 10:53:55.260463 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:55.260418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:55.261415 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:55.261357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:55.509936 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:55.509901    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:53:56.328435 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:56.328395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:56.428760 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:56.428726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:56.543523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:56.543485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:56.620714 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:56.620667    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:57.607572 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.607534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:57.669905 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.669866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:57.755523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.755490    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"]
Jul 17 10:53:57.758012 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.757987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.761638 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.761596    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 17 10:53:57.761784 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.761657    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 17 10:53:57.761784 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.761699    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 17 10:53:57.761784 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.761662    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d5q32n9ece5ag\""
Jul 17 10:53:57.761784 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.761657    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 17 10:53:57.761784 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.761764    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vbbz5\""
Jul 17 10:53:57.769665 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.769642    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"]
Jul 17 10:53:57.883576 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.883496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/29df68e3-c959-43a3-a4c4-003925146956-audit-log\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.883576 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.883542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-client-ca-bundle\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.883768 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.883643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29df68e3-c959-43a3-a4c4-003925146956-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.883768 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.883696    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-secret-metrics-server-client-certs\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.883768 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.883721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/29df68e3-c959-43a3-a4c4-003925146956-metrics-server-audit-profiles\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.883893 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.883790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-secret-metrics-server-tls\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.883893 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.883837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8xrf\" (UniqueName: \"kubernetes.io/projected/29df68e3-c959-43a3-a4c4-003925146956-kube-api-access-d8xrf\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.984468 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.984428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-secret-metrics-server-tls\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.984468 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.984476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8xrf\" (UniqueName: \"kubernetes.io/projected/29df68e3-c959-43a3-a4c4-003925146956-kube-api-access-d8xrf\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.984710 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.984521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/29df68e3-c959-43a3-a4c4-003925146956-audit-log\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.984710 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.984541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-client-ca-bundle\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.984710 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.984600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29df68e3-c959-43a3-a4c4-003925146956-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.984710 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.984648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-secret-metrics-server-client-certs\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.984710 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.984673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/29df68e3-c959-43a3-a4c4-003925146956-metrics-server-audit-profiles\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.985204 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.985154    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/29df68e3-c959-43a3-a4c4-003925146956-audit-log\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.985651 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.985599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29df68e3-c959-43a3-a4c4-003925146956-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.985760 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.985740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/29df68e3-c959-43a3-a4c4-003925146956-metrics-server-audit-profiles\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.987267 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.987241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-secret-metrics-server-tls\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.987502 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.987481    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-client-ca-bundle\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.987611 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.987587    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/29df68e3-c959-43a3-a4c4-003925146956-secret-metrics-server-client-certs\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:57.993137 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:57.993117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8xrf\" (UniqueName: \"kubernetes.io/projected/29df68e3-c959-43a3-a4c4-003925146956-kube-api-access-d8xrf\") pod \"metrics-server-7b89df7fd4-4mv5p\" (UID: \"29df68e3-c959-43a3-a4c4-003925146956\") " pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:58.070372 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:58.070326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:53:58.179809 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:58.179715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:58.281499 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:58.281462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:58.482528 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:58.482429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:59.682482 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:59.682422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:53:59.795334 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:53:59.795295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:02.176525 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:02.176409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:02.267229 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:02.267197    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:02.696529 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:02.696494    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:54:02.701688 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:54:02.701646    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9d1aa4_ae2e_4775_9c0a_ea04fa2cf304.slice/crio-869aa77b3a6b9b48770a235e31227f8752fe5661da7b2b3dfc2accd9de48b692 WatchSource:0}: Error finding container 869aa77b3a6b9b48770a235e31227f8752fe5661da7b2b3dfc2accd9de48b692: Status 404 returned error can't find the container with id 869aa77b3a6b9b48770a235e31227f8752fe5661da7b2b3dfc2accd9de48b692
Jul 17 10:54:02.724551 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:02.724336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"]
Jul 17 10:54:03.048721 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:03.048678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-6n64x" event={"ID":"b7a699db-cf90-4f66-b2dc-439565f827af","Type":"ContainerStarted","Data":"dbbc2d155470d31673981cc3ecf114b4919bea323163591711f240bbc668ca26"}
Jul 17 10:54:03.050812 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:03.050756    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-6n64x"
Jul 17 10:54:03.054295 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:03.053513    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p" event={"ID":"29df68e3-c959-43a3-a4c4-003925146956","Type":"ContainerStarted","Data":"3480b5960393585fb7a6972c88bb5f64cd1fd34bf2f6a5454f4e89c87b562204"}
Jul 17 10:54:03.055970 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:03.055847    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerStarted","Data":"869aa77b3a6b9b48770a235e31227f8752fe5661da7b2b3dfc2accd9de48b692"}
Jul 17 10:54:03.057678 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:03.057628    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-6n64x"
Jul 17 10:54:03.058933 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:03.058818    2562 generic.go:356] "Generic (PLEG): container finished" podID="7812efd6-a9a7-45e4-808b-8e015b74a664" containerID="c4a7ce324c579a6f4047aa6da4a2f8f2f1e708d5ec85eb978f99ce6680d0c089" exitCode=0
Jul 17 10:54:03.058933 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:03.058883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ng2jw" event={"ID":"7812efd6-a9a7-45e4-808b-8e015b74a664","Type":"ContainerDied","Data":"c4a7ce324c579a6f4047aa6da4a2f8f2f1e708d5ec85eb978f99ce6680d0c089"}
Jul 17 10:54:03.069064 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:03.069020    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-6n64x" podStartSLOduration=3.232824301 podStartE2EDuration="21.069004243s" totalImagesPullingTime="17.836179942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:54:03.068112491 +0000 UTC m=+83.873137978" watchObservedRunningTime="2026-07-17 10:54:03.069004243 +0000 UTC m=+83.874029728"
Jul 17 10:54:05.072158 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.072009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq" event={"ID":"13c835de-51e0-49db-b385-450d506822c3","Type":"ContainerStarted","Data":"1e6fd6953b6a4e1dbb66c5960e515f11a60a38502ad622b9e4fd9c103a20ab38"}
Jul 17 10:54:05.072158 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.072112    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq" event={"ID":"13c835de-51e0-49db-b385-450d506822c3","Type":"ContainerStarted","Data":"c04ec83d465451215ae6bd1926a350b1bf6e7dc4e166fcec6ad054e19a74b79a"}
Jul 17 10:54:05.075523 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.075489    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv" event={"ID":"8b142691-4915-4797-9311-7d7f6d7f360f","Type":"ContainerStarted","Data":"f841eb2f91875c7c84f8f83a8b9c7df24e062afc55d7d5906e0b018339572e96"}
Jul 17 10:54:05.083502 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.082920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ng2jw" event={"ID":"7812efd6-a9a7-45e4-808b-8e015b74a664","Type":"ContainerStarted","Data":"9a554968db92ad61fd7426d0587fb66458ab9a05b99e7ed067f9d7f8464e6a0d"}
Jul 17 10:54:05.083502 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.082975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ng2jw" event={"ID":"7812efd6-a9a7-45e4-808b-8e015b74a664","Type":"ContainerStarted","Data":"5163a0f5c2dfad8e4232d376c1f14f3a996010ae65811c142a81215acab83299"}
Jul 17 10:54:05.103592 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.103496    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wvbfv" podStartSLOduration=3.007204369 podStartE2EDuration="12.103477339s" totalImagesPullingTime="9.09627297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:54:05.103194993 +0000 UTC m=+85.908220511" watchObservedRunningTime="2026-07-17 10:54:05.103477339 +0000 UTC m=+85.908502824"
Jul 17 10:54:05.144728 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.144590    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ng2jw" podStartSLOduration=3.940064283 podStartE2EDuration="12.144566114s" totalImagesPullingTime="8.102162989s" totalInitContainerRuntime="102.338842ms" isStatefulPod=true podCreationTimestamp="2026-07-17 10:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:54:05.143362485 +0000 UTC m=+85.948387971" watchObservedRunningTime="2026-07-17 10:54:05.144566114 +0000 UTC m=+85.949591599"
Jul 17 10:54:05.611758 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.611722    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:05.705003 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.704954    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:05.960192 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:05.959400    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c6498b876-vhstv"
Jul 17 10:54:06.093056 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:06.093011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p" event={"ID":"29df68e3-c959-43a3-a4c4-003925146956","Type":"ContainerStarted","Data":"227c27dbbdb5e4abc1a639784a0673377df6096239671389f3155bf9756ea410"}
Jul 17 10:54:06.095095 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:06.095044    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerID="89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52" exitCode=0
Jul 17 10:54:06.095213 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:06.095109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerDied","Data":"89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52"}
Jul 17 10:54:06.097949 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:06.097927    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq" event={"ID":"13c835de-51e0-49db-b385-450d506822c3","Type":"ContainerStarted","Data":"913c14caf7a0c4b7e56542294c2bb56c0e4b0ae06b7b308b2bd1365bffa5c94f"}
Jul 17 10:54:06.126902 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:06.126816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p" podStartSLOduration=6.064183835 podStartE2EDuration="9.126796597s" totalImagesPullingTime="3.062612762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:54:06.125803165 +0000 UTC m=+86.930828654" watchObservedRunningTime="2026-07-17 10:54:06.126796597 +0000 UTC m=+86.931822086"
Jul 17 10:54:06.138538 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:06.138505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:06.192857 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:06.192799    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-gdhrq" podStartSLOduration=3.242014779 podStartE2EDuration="13.192782286s" totalImagesPullingTime="9.950767507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:54:06.192013157 +0000 UTC m=+86.997038635" watchObservedRunningTime="2026-07-17 10:54:06.192782286 +0000 UTC m=+86.997807770"
Jul 17 10:54:06.242634 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:06.242598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:07.025208 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:07.025170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:07.084723 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:07.084688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:07.359931 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:07.359895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:07.464222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:07.464138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:07.563045 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:07.562983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:08.026095 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:08.026035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:08.086873 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:08.086833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:09.117294 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:09.117257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerStarted","Data":"eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2"}
Jul 17 10:54:09.117733 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:09.117333    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerStarted","Data":"129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304"}
Jul 17 10:54:09.117733 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:09.117367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerStarted","Data":"93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30"}
Jul 17 10:54:09.117733 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:09.117407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerStarted","Data":"b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89"}
Jul 17 10:54:09.117733 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:09.117435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerStarted","Data":"9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243"}
Jul 17 10:54:12.137434 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:12.137394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerStarted","Data":"472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc"}
Jul 17 10:54:12.168534 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:12.168484    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=10.161931825 podStartE2EDuration="18.168468611s" totalImagesPullingTime="7.985021979s" totalInitContainerRuntime="21.514807ms" isStatefulPod=false podCreationTimestamp="2026-07-17 10:53:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:54:12.165677461 +0000 UTC m=+92.970702938" watchObservedRunningTime="2026-07-17 10:54:12.168468611 +0000 UTC m=+92.973494096"
Jul 17 10:54:15.469488 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:15.469446    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:15.569626 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:15.569598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:15.670893 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:15.670859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:15.875177 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:15.875141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:15.930293 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:15.930260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:18.070950 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:18.070914    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:54:18.071420 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:18.070979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:54:24.859487 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:24.859445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:25.680133 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:25.680063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:26.983374 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:26.983343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:27.046504 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:27.046470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:27.122031 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:27.121999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:29.550573 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:29.550534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:29.617990 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:29.617950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:30.458482 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:30.458439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:30.558339 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:30.558306    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:54:32.218662 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:32.218630    2562 generic.go:356] "Generic (PLEG): container finished" podID="8d300558-5661-4046-9a61-426b79e18bac" containerID="a43c72451f9c8475231b122534012a6484a4be2ddc359eac68956283989151c7" exitCode=0
Jul 17 10:54:32.219047 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:32.218693    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz" event={"ID":"8d300558-5661-4046-9a61-426b79e18bac","Type":"ContainerDied","Data":"a43c72451f9c8475231b122534012a6484a4be2ddc359eac68956283989151c7"}
Jul 17 10:54:32.219047 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:32.219003    2562 scope.go:117] "RemoveContainer" containerID="a43c72451f9c8475231b122534012a6484a4be2ddc359eac68956283989151c7"
Jul 17 10:54:33.223791 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:33.223754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4gkhz" event={"ID":"8d300558-5661-4046-9a61-426b79e18bac","Type":"ContainerStarted","Data":"5da4011f7a579bdd977749c8de9d6d2037c6982f604ec34bc49c708192090bf0"}
Jul 17 10:54:38.076040 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:38.076011    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:54:38.080026 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:54:38.080002    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b89df7fd4-4mv5p"
Jul 17 10:55:12.629743 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:12.629706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:12.854095 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:12.854043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:13.706240 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:13.706207    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:55:13.706637 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:13.706512    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="alertmanager" containerID="cri-o://9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243" gracePeriod=120
Jul 17 10:55:13.706637 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:13.706548    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy-metric" containerID="cri-o://eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2" gracePeriod=120
Jul 17 10:55:13.706637 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:13.706591    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="prom-label-proxy" containerID="cri-o://472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc" gracePeriod=120
Jul 17 10:55:13.706803 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:13.706615    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy-web" containerID="cri-o://93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30" gracePeriod=120
Jul 17 10:55:13.706803 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:13.706658    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="config-reloader" containerID="cri-o://b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89" gracePeriod=120
Jul 17 10:55:13.706803 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:13.706630    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy" containerID="cri-o://129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304" gracePeriod=120
Jul 17 10:55:14.381617 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381586    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerID="472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc" exitCode=0
Jul 17 10:55:14.381617 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381611    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerID="eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2" exitCode=0
Jul 17 10:55:14.381617 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381618    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerID="129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304" exitCode=0
Jul 17 10:55:14.381617 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381625    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerID="b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89" exitCode=0
Jul 17 10:55:14.381950 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381630    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerID="9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243" exitCode=0
Jul 17 10:55:14.381950 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerDied","Data":"472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc"}
Jul 17 10:55:14.381950 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerDied","Data":"eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2"}
Jul 17 10:55:14.381950 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381806    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerDied","Data":"129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304"}
Jul 17 10:55:14.381950 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerDied","Data":"b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89"}
Jul 17 10:55:14.381950 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.381885    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerDied","Data":"9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243"}
Jul 17 10:55:14.952092 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:14.952045    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.042188 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042115    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042188 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042150    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dff9\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-kube-api-access-6dff9\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042188 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042177    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-web\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042429 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042217    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042429 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042256    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-metrics-client-ca\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042429 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042285    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042429 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-main-tls\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042637 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-volume\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042637 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042485    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-cluster-tls-config\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042637 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042532    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-tls-assets\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042637 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042593    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-web-config\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042827 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042638    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-out\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042827 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042668    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-main-db\") pod \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\" (UID: \"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304\") "
Jul 17 10:55:15.042827 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042696    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:15.042827 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042708    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 10:55:15.043038 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042935    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-metrics-client-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.043038 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.042956    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.043536 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.043276    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:55:15.045024 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.044977    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:15.045159 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.045104    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:15.045236 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.045200    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-kube-api-access-6dff9" (OuterVolumeSpecName: "kube-api-access-6dff9") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "kube-api-access-6dff9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:55:15.045339 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.045300    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:15.045565 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.045539    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:15.045767 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.045746    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 10:55:15.046626 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.046602    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-volume" (OuterVolumeSpecName: "config-volume") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:15.047067 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.047048    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-out" (OuterVolumeSpecName: "config-out") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 10:55:15.049792 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.049768    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:15.055968 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.055947    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-web-config" (OuterVolumeSpecName: "web-config") pod "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" (UID: "7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 10:55:15.143540 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143513    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-web-config\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143540 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143539    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-out\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143548    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-alertmanager-main-db\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143561    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143571    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dff9\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-kube-api-access-6dff9\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143580    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143588    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143597    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-secret-alertmanager-main-tls\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143605    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-config-volume\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143613    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-cluster-tls-config\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.143682 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.143621    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304-tls-assets\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 10:55:15.388253 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.388224    2562 generic.go:356] "Generic (PLEG): container finished" podID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerID="93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30" exitCode=0
Jul 17 10:55:15.388400 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.388270    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerDied","Data":"93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30"}
Jul 17 10:55:15.388400 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.388300    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.388400 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.388325    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304","Type":"ContainerDied","Data":"869aa77b3a6b9b48770a235e31227f8752fe5661da7b2b3dfc2accd9de48b692"}
Jul 17 10:55:15.388400 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.388368    2562 scope.go:117] "RemoveContainer" containerID="472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc"
Jul 17 10:55:15.395997 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.395986    2562 scope.go:117] "RemoveContainer" containerID="eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2"
Jul 17 10:55:15.402574 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.402559    2562 scope.go:117] "RemoveContainer" containerID="129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304"
Jul 17 10:55:15.409043 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.409022    2562 scope.go:117] "RemoveContainer" containerID="93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30"
Jul 17 10:55:15.413915 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.413862    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:55:15.420165 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.420144    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:55:15.420513 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.420494    2562 scope.go:117] "RemoveContainer" containerID="b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89"
Jul 17 10:55:15.427414 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.427399    2562 scope.go:117] "RemoveContainer" containerID="9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243"
Jul 17 10:55:15.433939 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.433924    2562 scope.go:117] "RemoveContainer" containerID="89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52"
Jul 17 10:55:15.440697 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.440680    2562 scope.go:117] "RemoveContainer" containerID="472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc"
Jul 17 10:55:15.440939 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:55:15.440922    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc\": container with ID starting with 472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc not found: ID does not exist" containerID="472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc"
Jul 17 10:55:15.440998 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.440946    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc"} err="failed to get container status \"472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc\": rpc error: code = NotFound desc = could not find container \"472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc\": container with ID starting with 472755301e0576057cf276b345b2ce914d59acb3c70c9d7363f45791554decdc not found: ID does not exist"
Jul 17 10:55:15.440998 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.440976    2562 scope.go:117] "RemoveContainer" containerID="eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2"
Jul 17 10:55:15.441214 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:55:15.441197    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2\": container with ID starting with eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2 not found: ID does not exist" containerID="eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2"
Jul 17 10:55:15.441260 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.441220    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2"} err="failed to get container status \"eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2\": rpc error: code = NotFound desc = could not find container \"eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2\": container with ID starting with eee4ae2e2e879a7cd2e607b9f03ca5ef0fb3a80159f4836193acfb224a333ce2 not found: ID does not exist"
Jul 17 10:55:15.441260 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.441234    2562 scope.go:117] "RemoveContainer" containerID="129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304"
Jul 17 10:55:15.441438 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:55:15.441423    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304\": container with ID starting with 129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304 not found: ID does not exist" containerID="129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304"
Jul 17 10:55:15.441476 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.441442    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304"} err="failed to get container status \"129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304\": rpc error: code = NotFound desc = could not find container \"129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304\": container with ID starting with 129417dc70c3cd3292eb9f959f1a6f98d92f4864f503dbb9d44a8c9bac56a304 not found: ID does not exist"
Jul 17 10:55:15.441476 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.441454    2562 scope.go:117] "RemoveContainer" containerID="93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30"
Jul 17 10:55:15.441642 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:55:15.441625    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30\": container with ID starting with 93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30 not found: ID does not exist" containerID="93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30"
Jul 17 10:55:15.441683 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.441645    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30"} err="failed to get container status \"93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30\": rpc error: code = NotFound desc = could not find container \"93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30\": container with ID starting with 93eca9a62eab75bce3edddb732e85fdf6b6b8d7c19c52adac6048f97f6962a30 not found: ID does not exist"
Jul 17 10:55:15.441683 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.441656    2562 scope.go:117] "RemoveContainer" containerID="b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89"
Jul 17 10:55:15.441892 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:55:15.441875    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89\": container with ID starting with b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89 not found: ID does not exist" containerID="b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89"
Jul 17 10:55:15.441938 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.441901    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89"} err="failed to get container status \"b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89\": rpc error: code = NotFound desc = could not find container \"b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89\": container with ID starting with b33f5171531dc26632c60f4fd1dc5f2c804867055dbea641bb61309daee35a89 not found: ID does not exist"
Jul 17 10:55:15.441938 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.441918    2562 scope.go:117] "RemoveContainer" containerID="9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243"
Jul 17 10:55:15.442170 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:55:15.442149    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243\": container with ID starting with 9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243 not found: ID does not exist" containerID="9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243"
Jul 17 10:55:15.442215 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.442178    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243"} err="failed to get container status \"9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243\": rpc error: code = NotFound desc = could not find container \"9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243\": container with ID starting with 9cf4a3c4b4dc008619ab2b9326391ae9f3bde926aceb50003bb22407d022b243 not found: ID does not exist"
Jul 17 10:55:15.442215 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.442195    2562 scope.go:117] "RemoveContainer" containerID="89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52"
Jul 17 10:55:15.442415 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:55:15.442398    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52\": container with ID starting with 89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52 not found: ID does not exist" containerID="89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52"
Jul 17 10:55:15.442453 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.442419    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52"} err="failed to get container status \"89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52\": rpc error: code = NotFound desc = could not find container \"89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52\": container with ID starting with 89b89bdfef2843509de775b2ac192c13929dcec77bff8f183c9d8e4f3f30ab52 not found: ID does not exist"
Jul 17 10:55:15.445097 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445064    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:55:15.445365 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445353    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy"
Jul 17 10:55:15.445409 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445367    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy"
Jul 17 10:55:15.445409 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445382    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="alertmanager"
Jul 17 10:55:15.445409 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445389    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="alertmanager"
Jul 17 10:55:15.445409 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445399    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy-web"
Jul 17 10:55:15.445409 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445405    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy-web"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445413    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="config-reloader"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445419    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="config-reloader"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445428    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy-metric"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445433    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy-metric"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445442    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="init-config-reloader"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445447    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="init-config-reloader"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445453    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="prom-label-proxy"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445458    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="prom-label-proxy"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445508    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy-web"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445515    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="config-reloader"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445522    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="alertmanager"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445527    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445543    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="kube-rbac-proxy-metric"
Jul 17 10:55:15.445557 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.445551    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" containerName="prom-label-proxy"
Jul 17 10:55:15.448942 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.448926    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.451545 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.451528    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 17 10:55:15.451886 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.451857    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 17 10:55:15.451989 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.451857    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 17 10:55:15.451989 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.451907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 17 10:55:15.451989 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.451934    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 17 10:55:15.451989 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.451939    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 17 10:55:15.452190 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.452032    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-klrdl\""
Jul 17 10:55:15.452190 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.452059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 17 10:55:15.452190 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.452114    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 17 10:55:15.456389 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.456372    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 17 10:55:15.462916 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.462891    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:55:15.547809 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/100c4d58-1261-4d89-9232-dcfc41f01a00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.547809 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55t2d\" (UniqueName: \"kubernetes.io/projected/100c4d58-1261-4d89-9232-dcfc41f01a00-kube-api-access-55t2d\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548011 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548011 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/100c4d58-1261-4d89-9232-dcfc41f01a00-config-out\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548011 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548011 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548011 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548011 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-web-config\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548011 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.547971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/100c4d58-1261-4d89-9232-dcfc41f01a00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548273 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.548021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-config-volume\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548273 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.548115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/100c4d58-1261-4d89-9232-dcfc41f01a00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548273 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.548136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/100c4d58-1261-4d89-9232-dcfc41f01a00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.548273 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.548162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649296 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/100c4d58-1261-4d89-9232-dcfc41f01a00-config-out\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649296 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649296 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649502 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649502 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-web-config\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649502 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/100c4d58-1261-4d89-9232-dcfc41f01a00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649635 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-config-volume\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649635 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/100c4d58-1261-4d89-9232-dcfc41f01a00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649635 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/100c4d58-1261-4d89-9232-dcfc41f01a00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/100c4d58-1261-4d89-9232-dcfc41f01a00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55t2d\" (UniqueName: \"kubernetes.io/projected/100c4d58-1261-4d89-9232-dcfc41f01a00-kube-api-access-55t2d\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.649778 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.649751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.650873 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.650562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/100c4d58-1261-4d89-9232-dcfc41f01a00-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652202 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652070    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/100c4d58-1261-4d89-9232-dcfc41f01a00-config-out\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652576 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-web-config\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652576 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652420    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652576 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-config-volume\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652576 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652576 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652818 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652631    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652818 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652773    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/100c4d58-1261-4d89-9232-dcfc41f01a00-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.652883 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.652835    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/100c4d58-1261-4d89-9232-dcfc41f01a00-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.653103 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.653063    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/100c4d58-1261-4d89-9232-dcfc41f01a00-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.654302 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.654287    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/100c4d58-1261-4d89-9232-dcfc41f01a00-tls-assets\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.660755 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.660734    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55t2d\" (UniqueName: \"kubernetes.io/projected/100c4d58-1261-4d89-9232-dcfc41f01a00-kube-api-access-55t2d\") pod \"alertmanager-main-0\" (UID: \"100c4d58-1261-4d89-9232-dcfc41f01a00\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.679411 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.679387    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304" path="/var/lib/kubelet/pods/7c9d1aa4-ae2e-4775-9c0a-ea04fa2cf304/volumes"
Jul 17 10:55:15.758002 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.757975    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 17 10:55:15.906772 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:15.906668    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 17 10:55:15.909535 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:55:15.909506    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100c4d58_1261_4d89_9232_dcfc41f01a00.slice/crio-4e577dabd3102a0ac06f75db54d8d7cd25d5cc15b3666088dbcddbd0ef69a3dc WatchSource:0}: Error finding container 4e577dabd3102a0ac06f75db54d8d7cd25d5cc15b3666088dbcddbd0ef69a3dc: Status 404 returned error can't find the container with id 4e577dabd3102a0ac06f75db54d8d7cd25d5cc15b3666088dbcddbd0ef69a3dc
Jul 17 10:55:16.393224 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:16.393187    2562 generic.go:356] "Generic (PLEG): container finished" podID="100c4d58-1261-4d89-9232-dcfc41f01a00" containerID="16df31b5712302242f2f82d067c056160f87000e0c11912dd3f1db539af886de" exitCode=0
Jul 17 10:55:16.393610 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:16.393279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"100c4d58-1261-4d89-9232-dcfc41f01a00","Type":"ContainerDied","Data":"16df31b5712302242f2f82d067c056160f87000e0c11912dd3f1db539af886de"}
Jul 17 10:55:16.393610 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:16.393355    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"100c4d58-1261-4d89-9232-dcfc41f01a00","Type":"ContainerStarted","Data":"4e577dabd3102a0ac06f75db54d8d7cd25d5cc15b3666088dbcddbd0ef69a3dc"}
Jul 17 10:55:17.401506 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.401467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"100c4d58-1261-4d89-9232-dcfc41f01a00","Type":"ContainerStarted","Data":"7824044d18b0bf9880b137b2a2cd0b9de8c71f4352ef7523f84d63269f33ca78"}
Jul 17 10:55:17.401885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.401568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"100c4d58-1261-4d89-9232-dcfc41f01a00","Type":"ContainerStarted","Data":"aecde838498093b0a783c354103309999bcf58f2ef98258939968a99fe6c6a5c"}
Jul 17 10:55:17.401885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.401597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"100c4d58-1261-4d89-9232-dcfc41f01a00","Type":"ContainerStarted","Data":"3d90a9db8bd816d0a380d032de871701b3080bdb3d92f71865f768c339d1cd24"}
Jul 17 10:55:17.401885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.401621    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"100c4d58-1261-4d89-9232-dcfc41f01a00","Type":"ContainerStarted","Data":"d95f0defb5cd362cb9780e1877f8c35e02ddaafe3d125804dc2a71ee50523097"}
Jul 17 10:55:17.401885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.401643    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"100c4d58-1261-4d89-9232-dcfc41f01a00","Type":"ContainerStarted","Data":"a919913c1cee8a4cb76637065176cb46751404acd623df393bea9ffc597d157f"}
Jul 17 10:55:17.401885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.401666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"100c4d58-1261-4d89-9232-dcfc41f01a00","Type":"ContainerStarted","Data":"9065346f2e458ca24fb899d23ef79961a5d1a5a84b6b11c241b8aa794b0f3a37"}
Jul 17 10:55:17.432124 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.432059    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.416227398 podStartE2EDuration="2.432044137s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.816739ms" isStatefulPod=false podCreationTimestamp="2026-07-17 10:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:55:17.429436988 +0000 UTC m=+158.234462501" watchObservedRunningTime="2026-07-17 10:55:17.432044137 +0000 UTC m=+158.237069622"
Jul 17 10:55:17.770969 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.770891    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"]
Jul 17 10:55:17.773275 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.773258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.775980 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.775956    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8tnx5\""
Jul 17 10:55:17.776204 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.776188    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 17 10:55:17.776289 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.776271    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 17 10:55:17.776506 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.776489    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 17 10:55:17.776608 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.776493    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 17 10:55:17.776608 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.776493    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 17 10:55:17.780561 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.780540    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 17 10:55:17.787794 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.787771    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"]
Jul 17 10:55:17.867755 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.867721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.867885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.867774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-secret-telemeter-client\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.867885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.867795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-federate-client-tls\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.867885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.867832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j592q\" (UniqueName: \"kubernetes.io/projected/925cf275-c7cd-47d1-b498-565c27a85ba7-kube-api-access-j592q\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.867885 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.867871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.868027 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.867931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-serving-certs-ca-bundle\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.868027 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.867950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-telemeter-client-tls\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.868027 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.867983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-metrics-client-ca\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.968916 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.968881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969101 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.968927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-secret-telemeter-client\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969101 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.968945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-federate-client-tls\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969101 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.968963    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j592q\" (UniqueName: \"kubernetes.io/projected/925cf275-c7cd-47d1-b498-565c27a85ba7-kube-api-access-j592q\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969254 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.969096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969254 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.969164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-serving-certs-ca-bundle\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969254 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.969188    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-telemeter-client-tls\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969254 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.969225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-metrics-client-ca\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969994 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.969958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.969994 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.969970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-serving-certs-ca-bundle\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.970170 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.970105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/925cf275-c7cd-47d1-b498-565c27a85ba7-metrics-client-ca\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.971567 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.971544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-secret-telemeter-client\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.971717 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.971696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-telemeter-client-tls\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.971786 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.971745    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.971836 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.971806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/925cf275-c7cd-47d1-b498-565c27a85ba7-federate-client-tls\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:17.977010 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:17.976991    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j592q\" (UniqueName: \"kubernetes.io/projected/925cf275-c7cd-47d1-b498-565c27a85ba7-kube-api-access-j592q\") pod \"telemeter-client-5ddcb5f5b4-f64zc\" (UID: \"925cf275-c7cd-47d1-b498-565c27a85ba7\") " pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:18.083191 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:18.083129    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"
Jul 17 10:55:18.216913 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:18.216884    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc"]
Jul 17 10:55:18.219975 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:55:18.219949    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925cf275_c7cd_47d1_b498_565c27a85ba7.slice/crio-9830592e3007bd4ce1387db89dee11ab6cb600357361977cc48c41f00fd0a1b3 WatchSource:0}: Error finding container 9830592e3007bd4ce1387db89dee11ab6cb600357361977cc48c41f00fd0a1b3: Status 404 returned error can't find the container with id 9830592e3007bd4ce1387db89dee11ab6cb600357361977cc48c41f00fd0a1b3
Jul 17 10:55:18.406742 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:18.406708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc" event={"ID":"925cf275-c7cd-47d1-b498-565c27a85ba7","Type":"ContainerStarted","Data":"9830592e3007bd4ce1387db89dee11ab6cb600357361977cc48c41f00fd0a1b3"}
Jul 17 10:55:20.241382 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:20.241351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:20.416690 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:20.416593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc" event={"ID":"925cf275-c7cd-47d1-b498-565c27a85ba7","Type":"ContainerStarted","Data":"22714e8edd1fd4716c69113db1f84ffb0f5a1b0c9762ec140f1db1ede6ee9248"}
Jul 17 10:55:20.416690 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:20.416678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc" event={"ID":"925cf275-c7cd-47d1-b498-565c27a85ba7","Type":"ContainerStarted","Data":"3c081f8eb157662fba0aae79261fa5d3cc177ad43e1cb06b27fff49bdbf5f96f"}
Jul 17 10:55:20.416912 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:20.416697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc" event={"ID":"925cf275-c7cd-47d1-b498-565c27a85ba7","Type":"ContainerStarted","Data":"a8090f39e16b2f02814685688751b11c3dd660508e56d2cb2f362725ad9c4eab"}
Jul 17 10:55:20.441764 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:20.441716    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5ddcb5f5b4-f64zc" podStartSLOduration=1.548622035 podStartE2EDuration="3.441701218s" totalImagesPullingTime="1.893079183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:55:20.439954395 +0000 UTC m=+161.244979913" watchObservedRunningTime="2026-07-17 10:55:20.441701218 +0000 UTC m=+161.246726716"
Jul 17 10:55:21.426279 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:21.426250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:21.488920 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:21.488888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:21.578792 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:21.578758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:21.637570 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:21.637519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:22.185686 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:22.185631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:22.772774 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:22.772737    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:32.807094 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:32.806995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:32.907438 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:32.907408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:33.008634 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:33.008598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:34.932476 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:34.932437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:55:44.299585 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:55:44.299534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:00.381656 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:00.381622    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:00.441823 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:00.441796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:27.907704 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:27.907668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:27.963043 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:27.963011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:35.664696 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:35.664653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:39.932798 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:39.932757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:40.036070 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:40.036034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:45.470754 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:45.470715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:45.572799 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:45.572766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:46.071457 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:46.071415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:56:46.129217 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:56:46.129185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:01.856255 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:01.856166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:01.950718 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:01.950693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:28.588360 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:28.588330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:29.448955 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:29.448921    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:32.205898 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:32.205856    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:32.307068 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:32.307037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:33.920724 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:33.920684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:34.025927 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:34.025895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:34.537058 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:34.537016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:34.655280 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:34.655243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:36.154163 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:36.154124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:36.330667 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:36.330638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:39.194830 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:39.194798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:39.293866 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:39.293810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:39.597643 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:39.597561    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 10:57:44.575363 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:44.575328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:45.756802 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:45.756770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:47.070309 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.070275    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxbmh"]
Jul 17 10:57:47.073574 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.073558    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nxbmh"
Jul 17 10:57:47.076628 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.076602    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rvkpq\""
Jul 17 10:57:47.076966 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.076949    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 10:57:47.077513 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.077501    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 10:57:47.097306 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.097284    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxbmh"]
Jul 17 10:57:47.141870 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.141841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d96bfc42-9d39-4ec3-8158-e665ba4c3a81-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxbmh\" (UID: \"d96bfc42-9d39-4ec3-8158-e665ba4c3a81\") " pod="cert-manager/cert-manager-55b4d954d5-nxbmh"
Jul 17 10:57:47.142016 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.141898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g749\" (UniqueName: \"kubernetes.io/projected/d96bfc42-9d39-4ec3-8158-e665ba4c3a81-kube-api-access-5g749\") pod \"cert-manager-55b4d954d5-nxbmh\" (UID: \"d96bfc42-9d39-4ec3-8158-e665ba4c3a81\") " pod="cert-manager/cert-manager-55b4d954d5-nxbmh"
Jul 17 10:57:47.242256 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.242221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d96bfc42-9d39-4ec3-8158-e665ba4c3a81-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxbmh\" (UID: \"d96bfc42-9d39-4ec3-8158-e665ba4c3a81\") " pod="cert-manager/cert-manager-55b4d954d5-nxbmh"
Jul 17 10:57:47.242433 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.242311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g749\" (UniqueName: \"kubernetes.io/projected/d96bfc42-9d39-4ec3-8158-e665ba4c3a81-kube-api-access-5g749\") pod \"cert-manager-55b4d954d5-nxbmh\" (UID: \"d96bfc42-9d39-4ec3-8158-e665ba4c3a81\") " pod="cert-manager/cert-manager-55b4d954d5-nxbmh"
Jul 17 10:57:47.257129 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.257105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d96bfc42-9d39-4ec3-8158-e665ba4c3a81-bound-sa-token\") pod \"cert-manager-55b4d954d5-nxbmh\" (UID: \"d96bfc42-9d39-4ec3-8158-e665ba4c3a81\") " pod="cert-manager/cert-manager-55b4d954d5-nxbmh"
Jul 17 10:57:47.257320 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.257308    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g749\" (UniqueName: \"kubernetes.io/projected/d96bfc42-9d39-4ec3-8158-e665ba4c3a81-kube-api-access-5g749\") pod \"cert-manager-55b4d954d5-nxbmh\" (UID: \"d96bfc42-9d39-4ec3-8158-e665ba4c3a81\") " pod="cert-manager/cert-manager-55b4d954d5-nxbmh"
Jul 17 10:57:47.382547 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.382519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nxbmh"
Jul 17 10:57:47.513418 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.513392    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nxbmh"]
Jul 17 10:57:47.515365 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:57:47.515337    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd96bfc42_9d39_4ec3_8158_e665ba4c3a81.slice/crio-e6f93a554d7afd648f1f779155a9d529af05cb37ee52118066a6912279a01db2 WatchSource:0}: Error finding container e6f93a554d7afd648f1f779155a9d529af05cb37ee52118066a6912279a01db2: Status 404 returned error can't find the container with id e6f93a554d7afd648f1f779155a9d529af05cb37ee52118066a6912279a01db2
Jul 17 10:57:47.517256 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.517236    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 10:57:47.972991 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:47.972957    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nxbmh" event={"ID":"d96bfc42-9d39-4ec3-8158-e665ba4c3a81","Type":"ContainerStarted","Data":"e6f93a554d7afd648f1f779155a9d529af05cb37ee52118066a6912279a01db2"}
Jul 17 10:57:50.989430 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:50.989340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nxbmh" event={"ID":"d96bfc42-9d39-4ec3-8158-e665ba4c3a81","Type":"ContainerStarted","Data":"2e7d655b523b4560f899f185f371ce81362e9bc319f27b70473bcf084253f53f"}
Jul 17 10:57:50.991859 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:50.991829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:51.006058 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:51.006003    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nxbmh" podStartSLOduration=0.904540629 podStartE2EDuration="4.00598361s" totalImagesPullingTime="3.101442981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:57:51.005642708 +0000 UTC m=+311.810668228" watchObservedRunningTime="2026-07-17 10:57:51.00598361 +0000 UTC m=+311.811009096"
Jul 17 10:57:51.086955 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:51.086925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:57:52.886935 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:57:52.886902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:05.685271 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:05.685230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:05.778625 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:05.778584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:07.574872 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:07.574837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:07.672924 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:07.672879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:08.190095 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.190047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:08.401836 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.401806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:08.506708 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.506623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:08.572223 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.572189    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"]
Jul 17 10:58:08.575531 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.575511    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.578744 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.578724    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 10:58:08.578832 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.578805    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zjf47\""
Jul 17 10:58:08.579341 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.579324    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 10:58:08.579413 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.579323    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 10:58:08.582450 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.582434    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 10:58:08.601361 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.601337    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"]
Jul 17 10:58:08.616873 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.616846    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-manifests\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.616975 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.616884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.616975 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.616906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.617041 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.617002    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-tmp\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.617041 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.617027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9z5x\" (UniqueName: \"kubernetes.io/projected/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-kube-api-access-g9z5x\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.718324 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.718289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-manifests\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.718324 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.718329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.718519 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.718356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.718519 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.718395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-tmp\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.718519 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.718412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9z5x\" (UniqueName: \"kubernetes.io/projected/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-kube-api-access-g9z5x\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.718763 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.718738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-manifests\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.720620 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.720592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-tmp\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.720835 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.720819    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-webhook-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.720939 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.720921    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.732853 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.732826    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9z5x\" (UniqueName: \"kubernetes.io/projected/65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda-kube-api-access-g9z5x\") pod \"opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m\" (UID: \"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda\") " pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.784580 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.784501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:08.885624 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.885600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:08.887700 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.887674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:08.987726 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:08.987693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:09.035017 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:09.034992    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"]
Jul 17 10:58:09.037737 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:58:09.037706    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65bab7a9_bf7c_461e_b7ff_3a9a30ae0fda.slice/crio-d41c6cc2d576c6899d68dec78b2dfa34ddd4ee24fc72aa28505230fb3c30d924 WatchSource:0}: Error finding container d41c6cc2d576c6899d68dec78b2dfa34ddd4ee24fc72aa28505230fb3c30d924: Status 404 returned error can't find the container with id d41c6cc2d576c6899d68dec78b2dfa34ddd4ee24fc72aa28505230fb3c30d924
Jul 17 10:58:09.058891 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:09.058864    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m" event={"ID":"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda","Type":"ContainerStarted","Data":"d41c6cc2d576c6899d68dec78b2dfa34ddd4ee24fc72aa28505230fb3c30d924"}
Jul 17 10:58:09.092204 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:09.092173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:09.203220 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:09.203188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:09.309748 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:09.309649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:09.402700 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:09.402676    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:11.244894 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:11.244861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:11.345450 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:11.345392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:13.078151 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:13.078116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m" event={"ID":"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda","Type":"ContainerStarted","Data":"838419d506a34d99979b76fbbfea4084e407377c67b0ac94efdc333a29408318"}
Jul 17 10:58:14.083733 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:14.083696    2562 generic.go:356] "Generic (PLEG): container finished" podID="65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda" containerID="838419d506a34d99979b76fbbfea4084e407377c67b0ac94efdc333a29408318" exitCode=0
Jul 17 10:58:14.084130 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:14.083750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m" event={"ID":"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda","Type":"ContainerDied","Data":"838419d506a34d99979b76fbbfea4084e407377c67b0ac94efdc333a29408318"}
Jul 17 10:58:15.089912 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:15.089829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m" event={"ID":"65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda","Type":"ContainerStarted","Data":"537b29cf75985905fe2fb7b4e63bb3770dc74d021728d045527896c33ea445c1"}
Jul 17 10:58:15.090282 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:15.089966    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:15.114765 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:15.114714    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m" podStartSLOduration=2.5496411759999997 podStartE2EDuration="7.114696295s" totalImagesPullingTime="3.52488053s" totalInitContainerRuntime="1.040174589s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:15.113260978 +0000 UTC m=+335.918286455" watchObservedRunningTime="2026-07-17 10:58:15.114696295 +0000 UTC m=+335.919721781"
Jul 17 10:58:23.007878 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:23.007829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:23.075285 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:23.075252    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:26.097116 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:26.097071    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m"
Jul 17 10:58:28.003463 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.003422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:28.139684 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.139646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:28.533813 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.533780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:28.567854 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.567822    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"]
Jul 17 10:58:28.579405 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.579376    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.582612 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.582586    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mf6d9\""
Jul 17 10:58:28.582755 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.582702    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 10:58:28.583422 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.583403    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 10:58:28.595503 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.595462    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"]
Jul 17 10:58:28.685819 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.685780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0540d2-666f-4247-95db-81c3c5605111-tmp\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.685990 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.685867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0540d2-666f-4247-95db-81c3c5605111-tls-certs\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.685990 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.685892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsvgq\" (UniqueName: \"kubernetes.io/projected/6a0540d2-666f-4247-95db-81c3c5605111-kube-api-access-dsvgq\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.699462 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.699434    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qwpht"]
Jul 17 10:58:28.701735 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.701720    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:28.704275 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.704252    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 10:58:28.704398 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.704350    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-44x4m\""
Jul 17 10:58:28.720174 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.720144    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qwpht"]
Jul 17 10:58:28.783634 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.783586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:28.786585 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.786537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdgfw\" (UniqueName: \"kubernetes.io/projected/7d746b3c-315f-4491-ac00-27c89b9a6a4d-kube-api-access-rdgfw\") pod \"odh-model-controller-7998c67dc4-qwpht\" (UID: \"7d746b3c-315f-4491-ac00-27c89b9a6a4d\") " pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:28.786585 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.786566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d746b3c-315f-4491-ac00-27c89b9a6a4d-cert\") pod \"odh-model-controller-7998c67dc4-qwpht\" (UID: \"7d746b3c-315f-4491-ac00-27c89b9a6a4d\") " pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:28.786721 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.786587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0540d2-666f-4247-95db-81c3c5605111-tmp\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.786721 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.786681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0540d2-666f-4247-95db-81c3c5605111-tls-certs\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.786721 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.786703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsvgq\" (UniqueName: \"kubernetes.io/projected/6a0540d2-666f-4247-95db-81c3c5605111-kube-api-access-dsvgq\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.786871 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:58:28.786780    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 17 10:58:28.786871 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:58:28.786859    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a0540d2-666f-4247-95db-81c3c5605111-tls-certs podName:6a0540d2-666f-4247-95db-81c3c5605111 nodeName:}" failed. No retries permitted until 2026-07-17 10:58:29.286844367 +0000 UTC m=+350.091869830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6a0540d2-666f-4247-95db-81c3c5605111-tls-certs") pod "kube-auth-proxy-5445b9658d-sgn5m" (UID: "6a0540d2-666f-4247-95db-81c3c5605111") : secret "kube-auth-proxy-tls" not found
Jul 17 10:58:28.788738 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.788719    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0540d2-666f-4247-95db-81c3c5605111-tmp\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.802222 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.802195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsvgq\" (UniqueName: \"kubernetes.io/projected/6a0540d2-666f-4247-95db-81c3c5605111-kube-api-access-dsvgq\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:28.882177 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.882146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:28.887120 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.887100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdgfw\" (UniqueName: \"kubernetes.io/projected/7d746b3c-315f-4491-ac00-27c89b9a6a4d-kube-api-access-rdgfw\") pod \"odh-model-controller-7998c67dc4-qwpht\" (UID: \"7d746b3c-315f-4491-ac00-27c89b9a6a4d\") " pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:28.887211 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.887132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d746b3c-315f-4491-ac00-27c89b9a6a4d-cert\") pod \"odh-model-controller-7998c67dc4-qwpht\" (UID: \"7d746b3c-315f-4491-ac00-27c89b9a6a4d\") " pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:28.887269 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:58:28.887235    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 17 10:58:28.887334 ip-10-0-131-178 kubenswrapper[2562]: E0717 10:58:28.887321    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d746b3c-315f-4491-ac00-27c89b9a6a4d-cert podName:7d746b3c-315f-4491-ac00-27c89b9a6a4d nodeName:}" failed. No retries permitted until 2026-07-17 10:58:29.387299325 +0000 UTC m=+350.192324807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d746b3c-315f-4491-ac00-27c89b9a6a4d-cert") pod "odh-model-controller-7998c67dc4-qwpht" (UID: "7d746b3c-315f-4491-ac00-27c89b9a6a4d") : secret "odh-model-controller-webhook-cert" not found
Jul 17 10:58:28.902678 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:28.902648    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdgfw\" (UniqueName: \"kubernetes.io/projected/7d746b3c-315f-4491-ac00-27c89b9a6a4d-kube-api-access-rdgfw\") pod \"odh-model-controller-7998c67dc4-qwpht\" (UID: \"7d746b3c-315f-4491-ac00-27c89b9a6a4d\") " pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:29.047967 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.047885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:29.144590 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.144563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:29.290958 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.290928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0540d2-666f-4247-95db-81c3c5605111-tls-certs\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:29.293347 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.293325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a0540d2-666f-4247-95db-81c3c5605111-tls-certs\") pod \"kube-auth-proxy-5445b9658d-sgn5m\" (UID: \"6a0540d2-666f-4247-95db-81c3c5605111\") " pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:29.391863 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.391830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d746b3c-315f-4491-ac00-27c89b9a6a4d-cert\") pod \"odh-model-controller-7998c67dc4-qwpht\" (UID: \"7d746b3c-315f-4491-ac00-27c89b9a6a4d\") " pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:29.394146 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.394125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d746b3c-315f-4491-ac00-27c89b9a6a4d-cert\") pod \"odh-model-controller-7998c67dc4-qwpht\" (UID: \"7d746b3c-315f-4491-ac00-27c89b9a6a4d\") " pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:29.489249 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.489215    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"
Jul 17 10:58:29.612613 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.612572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:29.641199 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.641069    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m"]
Jul 17 10:58:29.643297 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:58:29.643215    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0540d2_666f_4247_95db_81c3c5605111.slice/crio-7fad3e59dbd1ae42900603c428c9b5729e8f4a1d3864728cf6fa3f216915c4c9 WatchSource:0}: Error finding container 7fad3e59dbd1ae42900603c428c9b5729e8f4a1d3864728cf6fa3f216915c4c9: Status 404 returned error can't find the container with id 7fad3e59dbd1ae42900603c428c9b5729e8f4a1d3864728cf6fa3f216915c4c9
Jul 17 10:58:29.752815 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.752782    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qwpht"]
Jul 17 10:58:29.756425 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:58:29.756400    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d746b3c_315f_4491_ac00_27c89b9a6a4d.slice/crio-f9268cae992d916ca1e4bfb3ef6e8b59c66562cfb4059c7ae453febb5e32c043 WatchSource:0}: Error finding container f9268cae992d916ca1e4bfb3ef6e8b59c66562cfb4059c7ae453febb5e32c043: Status 404 returned error can't find the container with id f9268cae992d916ca1e4bfb3ef6e8b59c66562cfb4059c7ae453febb5e32c043
Jul 17 10:58:29.839202 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.839160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:29.932695 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:29.932602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:30.139162 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:30.139128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:30.154264 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:30.154222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qwpht" event={"ID":"7d746b3c-315f-4491-ac00-27c89b9a6a4d","Type":"ContainerStarted","Data":"f9268cae992d916ca1e4bfb3ef6e8b59c66562cfb4059c7ae453febb5e32c043"}
Jul 17 10:58:30.155406 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:30.155377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m" event={"ID":"6a0540d2-666f-4247-95db-81c3c5605111","Type":"ContainerStarted","Data":"7fad3e59dbd1ae42900603c428c9b5729e8f4a1d3864728cf6fa3f216915c4c9"}
Jul 17 10:58:30.223965 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:30.223885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:31.475004 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:31.474967    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:33.685709 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:33.685668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:33.783135 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:33.783091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:34.177799 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.177767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m" event={"ID":"6a0540d2-666f-4247-95db-81c3c5605111","Type":"ContainerStarted","Data":"6179aeaf83e81f5814a7ad63d518dbc1c2197d9cfa0413babbe5e725e50031f5"}
Jul 17 10:58:34.179415 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.179384    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qwpht" event={"ID":"7d746b3c-315f-4491-ac00-27c89b9a6a4d","Type":"ContainerStarted","Data":"83739ee94d4e7d122e9d4988a7aa7b56ac0bf9d226ccb889a08a53657cf081b7"}
Jul 17 10:58:34.179550 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.179530    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:34.197357 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.197312    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5445b9658d-sgn5m" podStartSLOduration=2.66630168 podStartE2EDuration="6.197299896s" totalImagesPullingTime="3.530998216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:34.195871333 +0000 UTC m=+355.000896819" watchObservedRunningTime="2026-07-17 10:58:34.197299896 +0000 UTC m=+355.002325381"
Jul 17 10:58:34.215020 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.214963    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qwpht" podStartSLOduration=2.795899928 podStartE2EDuration="6.21494832s" totalImagesPullingTime="3.419048392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:34.213559267 +0000 UTC m=+355.018584756" watchObservedRunningTime="2026-07-17 10:58:34.21494832 +0000 UTC m=+355.019973807"
Jul 17 10:58:34.420987 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.420958    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"]
Jul 17 10:58:34.423456 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.423441    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.427689 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.427666    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hcsk4\""
Jul 17 10:58:34.427833 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.427671    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 10:58:34.439601 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.439576    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"]
Jul 17 10:58:34.453046 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.453006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:34.538281 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.538445 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.538445 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.538445 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.538623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.538623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.538623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.538623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjx6c\" (UniqueName: \"kubernetes.io/projected/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-kube-api-access-zjx6c\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.538623 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.538616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.639702 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.639883 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.639883 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.639883 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639777    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.639883 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.639883 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjx6c\" (UniqueName: \"kubernetes.io/projected/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-kube-api-access-zjx6c\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.640180 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.640180 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.640180 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.639983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.640337 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.640277    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.640427 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.640408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.640427 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.640414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.640519 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.640501    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.640752 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.640729    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.641976 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.641956    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.642291 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.642276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.647507 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.647480    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.647607 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.647560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjx6c\" (UniqueName: \"kubernetes.io/projected/7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54-kube-api-access-zjx6c\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678t8v7l\" (UID: \"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.733611 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.733537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:34.774849 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.774806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:34.877656 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.877523    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:34.877656 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:34.877626    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"]
Jul 17 10:58:34.879858 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:58:34.879835    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b53c4fe_a852_4a1d_ad21_b25cfdcc8d54.slice/crio-fee4e3909728555e57222032154cfaff33da65ef01c53dd4b5d593d20ebed763 WatchSource:0}: Error finding container fee4e3909728555e57222032154cfaff33da65ef01c53dd4b5d593d20ebed763: Status 404 returned error can't find the container with id fee4e3909728555e57222032154cfaff33da65ef01c53dd4b5d593d20ebed763
Jul 17 10:58:35.186653 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:35.186617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l" event={"ID":"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54","Type":"ContainerStarted","Data":"fee4e3909728555e57222032154cfaff33da65ef01c53dd4b5d593d20ebed763"}
Jul 17 10:58:37.369193 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.369145    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"]
Jul 17 10:58:37.376330 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.376306    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.385512 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.385487    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 10:58:37.388220 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.388199    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 10:58:37.388336 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.388318    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-l72dz\""
Jul 17 10:58:37.388477 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.388462    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 10:58:37.391280 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.391263    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 10:58:37.391280 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.391277    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 10:58:37.397449 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.397427    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"]
Jul 17 10:58:37.449806 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.449752    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:58:37.449933 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.449843    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:58:37.449933 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.449890    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 10:58:37.568418 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.568378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rxd\" (UniqueName: \"kubernetes.io/projected/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-kube-api-access-f4rxd\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.568418 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.568412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-cert\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.568651 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.568457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-manager-config\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.568651 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.568559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-metrics-cert\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.669918 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.669817    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rxd\" (UniqueName: \"kubernetes.io/projected/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-kube-api-access-f4rxd\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.669918 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.669872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-cert\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.670163 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.669934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-manager-config\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.670163 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.669991    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-metrics-cert\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.670804 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.670772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-manager-config\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.672717 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.672694    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-metrics-cert\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.672810 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.672699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-cert\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.679182 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.679160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rxd\" (UniqueName: \"kubernetes.io/projected/1d83f22c-fb0d-47a0-80af-c0ebc822a39c-kube-api-access-f4rxd\") pod \"lws-controller-manager-9895988c6-5kcbl\" (UID: \"1d83f22c-fb0d-47a0-80af-c0ebc822a39c\") " pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.687030 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.686777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:37.878200 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:37.878176    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"]
Jul 17 10:58:37.879177 ip-10-0-131-178 kubenswrapper[2562]: W0717 10:58:37.879153    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d83f22c_fb0d_47a0_80af_c0ebc822a39c.slice/crio-0372ef0b09d9d82505d552b8704f3e3f4dd7ed35d91e8e3abffb2a82d2b276cc WatchSource:0}: Error finding container 0372ef0b09d9d82505d552b8704f3e3f4dd7ed35d91e8e3abffb2a82d2b276cc: Status 404 returned error can't find the container with id 0372ef0b09d9d82505d552b8704f3e3f4dd7ed35d91e8e3abffb2a82d2b276cc
Jul 17 10:58:38.205737 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:38.205698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l" event={"ID":"7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54","Type":"ContainerStarted","Data":"8d25443e18645dfadb146df8ad17d2efc20c0714c6f19fee2ae1ca04117afe9b"}
Jul 17 10:58:38.207367 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:38.207339    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl" event={"ID":"1d83f22c-fb0d-47a0-80af-c0ebc822a39c","Type":"ContainerStarted","Data":"0372ef0b09d9d82505d552b8704f3e3f4dd7ed35d91e8e3abffb2a82d2b276cc"}
Jul 17 10:58:38.236653 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:38.236593    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l" podStartSLOduration=1.668858569 podStartE2EDuration="4.236572011s" totalImagesPullingTime="2.567713442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:38.234619829 +0000 UTC m=+359.039645343" watchObservedRunningTime="2026-07-17 10:58:38.236572011 +0000 UTC m=+359.041597915"
Jul 17 10:58:38.734645 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:38.734605    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:38.740122 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:38.740099    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:39.212799 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:39.212769    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:39.213876 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:39.213854    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678t8v7l"
Jul 17 10:58:39.928482 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:39.928449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:40.038096 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:40.038040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:40.160434 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:40.160401    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:40.219913 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:40.219824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl" event={"ID":"1d83f22c-fb0d-47a0-80af-c0ebc822a39c","Type":"ContainerStarted","Data":"4ff1ef5f73f4e7159384540fdba4b9d950a61fbb60760c282fc82a426e89e236"}
Jul 17 10:58:40.220096 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:40.219915    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:58:40.253197 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:40.253147    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl" podStartSLOduration=1.184553746 podStartE2EDuration="3.25313057s" totalImagesPullingTime="2.068576824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:58:40.252896183 +0000 UTC m=+361.057921668" watchObservedRunningTime="2026-07-17 10:58:40.25313057 +0000 UTC m=+361.058156080"
Jul 17 10:58:40.366522 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:40.366486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:40.570860 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:40.570784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:40.815632 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:40.815598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:45.188430 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:45.188397    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qwpht"
Jul 17 10:58:48.618460 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:48.618429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:48.693245 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:48.693212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:58:51.227037 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:58:51.227004    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9895988c6-5kcbl"
Jul 17 10:59:18.020787 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:18.020755    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:23.417499 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:23.417468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:25.211747 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:25.211708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:25.313072 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:25.313036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:29.532943 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:29.532898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:29.650493 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:29.650462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:29.751360 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:29.751328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:30.446582 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:30.446544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:30.658322 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:30.658285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:39.371945 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:39.371899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:59.068730 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:59.068691    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 10:59:59.257658 ip-10-0-131-178 kubenswrapper[2562]: I0717 10:59:59.257624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:02.691912 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:02.691817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:05.537868 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:05.537826    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:07.135005 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:07.134967    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:07.326937 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:07.326904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:07.918480 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:07.918444    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:10.371401 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:10.371367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:11.314092 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:11.314047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:13.194416 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:13.194362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:14.842044 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:14.842003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:14.949300 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:14.949266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:16.422779 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:16.422745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:16.540282 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:16.540248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:18.552800 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:18.552766    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:18.655971 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:18.655933    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:25.008551 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:25.008514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:25.138767 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:25.138734    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:28.074396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:28.074351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:28.182020 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:28.181988    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:30.999548 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:30.999513    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:31.202864 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:31.202829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:33.543649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:33.543610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:33.654119 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:33.654069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:36.281302 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:36.281268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:36.414005 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:36.413962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:36.565308 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:36.565228    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:37.342684 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:37.342649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:37.414925 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:37.414886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:46.164331 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:46.164296    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:46.271913 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:46.271865    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:49.134624 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:49.134590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:00:49.228982 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:00:49.228946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:05.655230 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:05.655181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:05.914471 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:05.914381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:10.356586 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:10.356536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:10.441139 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:10.441109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:11.103448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.103413    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-mh6fv"]
Jul 17 11:01:11.105812 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.105792    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mh6fv"
Jul 17 11:01:11.108339 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.108311    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 11:01:11.108449 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.108311    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 11:01:11.109181 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.109163    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t74t7\""
Jul 17 11:01:11.116793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.116773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mh6fv"]
Jul 17 11:01:11.141053 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.141029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:11.221741 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.221713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:11.229205 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.229178    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7hbnt"]
Jul 17 11:01:11.231410 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.231389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7hbnt"
Jul 17 11:01:11.239002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.238978    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7hbnt"]
Jul 17 11:01:11.279819 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.279781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw9cc\" (UniqueName: \"kubernetes.io/projected/fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf-kube-api-access-nw9cc\") pod \"authorino-58cd955675-mh6fv\" (UID: \"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf\") " pod="kuadrant-system/authorino-58cd955675-mh6fv"
Jul 17 11:01:11.380508 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.380473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpb48\" (UniqueName: \"kubernetes.io/projected/96af58e0-7ba1-461a-9062-a220456f7b33-kube-api-access-xpb48\") pod \"authorino-75d556bd77-7hbnt\" (UID: \"96af58e0-7ba1-461a-9062-a220456f7b33\") " pod="kuadrant-system/authorino-75d556bd77-7hbnt"
Jul 17 11:01:11.380872 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.380536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw9cc\" (UniqueName: \"kubernetes.io/projected/fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf-kube-api-access-nw9cc\") pod \"authorino-58cd955675-mh6fv\" (UID: \"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf\") " pod="kuadrant-system/authorino-58cd955675-mh6fv"
Jul 17 11:01:11.389197 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.389167    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw9cc\" (UniqueName: \"kubernetes.io/projected/fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf-kube-api-access-nw9cc\") pod \"authorino-58cd955675-mh6fv\" (UID: \"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf\") " pod="kuadrant-system/authorino-58cd955675-mh6fv"
Jul 17 11:01:11.415486 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.415465    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mh6fv"
Jul 17 11:01:11.481599 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.481571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpb48\" (UniqueName: \"kubernetes.io/projected/96af58e0-7ba1-461a-9062-a220456f7b33-kube-api-access-xpb48\") pod \"authorino-75d556bd77-7hbnt\" (UID: \"96af58e0-7ba1-461a-9062-a220456f7b33\") " pod="kuadrant-system/authorino-75d556bd77-7hbnt"
Jul 17 11:01:11.490525 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.490502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpb48\" (UniqueName: \"kubernetes.io/projected/96af58e0-7ba1-461a-9062-a220456f7b33-kube-api-access-xpb48\") pod \"authorino-75d556bd77-7hbnt\" (UID: \"96af58e0-7ba1-461a-9062-a220456f7b33\") " pod="kuadrant-system/authorino-75d556bd77-7hbnt"
Jul 17 11:01:11.540340 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.540156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7hbnt"
Jul 17 11:01:11.542134 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.542100    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-mh6fv"]
Jul 17 11:01:11.545072 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:01:11.545049    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe4134d3_6ea9_4caa_b6f3_e0cee74bdeaf.slice/crio-cfbc2adf44205998ef9f10ea34f96f315462ddd66e77a3408fc849ef2b50edfa WatchSource:0}: Error finding container cfbc2adf44205998ef9f10ea34f96f315462ddd66e77a3408fc849ef2b50edfa: Status 404 returned error can't find the container with id cfbc2adf44205998ef9f10ea34f96f315462ddd66e77a3408fc849ef2b50edfa
Jul 17 11:01:11.669001 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.668971    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7hbnt"]
Jul 17 11:01:11.671220 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:01:11.671192    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96af58e0_7ba1_461a_9062_a220456f7b33.slice/crio-93ade78c0ebdab2781f783f19eff298792229e481b8520cc6350cd2cec83c736 WatchSource:0}: Error finding container 93ade78c0ebdab2781f783f19eff298792229e481b8520cc6350cd2cec83c736: Status 404 returned error can't find the container with id 93ade78c0ebdab2781f783f19eff298792229e481b8520cc6350cd2cec83c736
Jul 17 11:01:11.887125 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.887063    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7hbnt" event={"ID":"96af58e0-7ba1-461a-9062-a220456f7b33","Type":"ContainerStarted","Data":"93ade78c0ebdab2781f783f19eff298792229e481b8520cc6350cd2cec83c736"}
Jul 17 11:01:11.888267 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:11.888244    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mh6fv" event={"ID":"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf","Type":"ContainerStarted","Data":"cfbc2adf44205998ef9f10ea34f96f315462ddd66e77a3408fc849ef2b50edfa"}
Jul 17 11:01:15.913403 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:15.913359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7hbnt" event={"ID":"96af58e0-7ba1-461a-9062-a220456f7b33","Type":"ContainerStarted","Data":"eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882"}
Jul 17 11:01:15.914884 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:15.914853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mh6fv" event={"ID":"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf","Type":"ContainerStarted","Data":"83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73"}
Jul 17 11:01:15.929002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:15.928961    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7hbnt" podStartSLOduration=1.437373065 podStartE2EDuration="4.928946925s" totalImagesPullingTime="3.49157386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:15.927808682 +0000 UTC m=+516.732834194" watchObservedRunningTime="2026-07-17 11:01:15.928946925 +0000 UTC m=+516.733972410"
Jul 17 11:01:15.942982 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:15.942935    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-mh6fv" podStartSLOduration=1.3287956140000001 podStartE2EDuration="4.942913702s" totalImagesPullingTime="3.614118088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:15.941722253 +0000 UTC m=+516.746747738" watchObservedRunningTime="2026-07-17 11:01:15.942913702 +0000 UTC m=+516.747939190"
Jul 17 11:01:15.967817 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:15.967788    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mh6fv"]
Jul 17 11:01:17.923929 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:17.923875    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-mh6fv" podUID="fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf" containerName="authorino" containerID="cri-o://83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73" gracePeriod=30
Jul 17 11:01:18.176020 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.175955    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mh6fv"
Jul 17 11:01:18.235858 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.235829    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw9cc\" (UniqueName: \"kubernetes.io/projected/fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf-kube-api-access-nw9cc\") pod \"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf\" (UID: \"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf\") "
Jul 17 11:01:18.237968 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.237943    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf-kube-api-access-nw9cc" (OuterVolumeSpecName: "kube-api-access-nw9cc") pod "fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf" (UID: "fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf"). InnerVolumeSpecName "kube-api-access-nw9cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:01:18.337143 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.337106    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw9cc\" (UniqueName: \"kubernetes.io/projected/fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf-kube-api-access-nw9cc\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:01:18.929483 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.929443    2562 generic.go:356] "Generic (PLEG): container finished" podID="fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf" containerID="83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73" exitCode=0
Jul 17 11:01:18.929483 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.929483    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-mh6fv"
Jul 17 11:01:18.929921 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.929531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mh6fv" event={"ID":"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf","Type":"ContainerDied","Data":"83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73"}
Jul 17 11:01:18.929921 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.929568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-mh6fv" event={"ID":"fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf","Type":"ContainerDied","Data":"cfbc2adf44205998ef9f10ea34f96f315462ddd66e77a3408fc849ef2b50edfa"}
Jul 17 11:01:18.929921 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.929589    2562 scope.go:117] "RemoveContainer" containerID="83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73"
Jul 17 11:01:18.938161 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.938140    2562 scope.go:117] "RemoveContainer" containerID="83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73"
Jul 17 11:01:18.938440 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:01:18.938419    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73\": container with ID starting with 83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73 not found: ID does not exist" containerID="83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73"
Jul 17 11:01:18.938498 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.938449    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73"} err="failed to get container status \"83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73\": rpc error: code = NotFound desc = could not find container \"83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73\": container with ID starting with 83caa59625c7ed76d9194b11839d7940dde7e9f51641c60ab285df50550fbe73 not found: ID does not exist"
Jul 17 11:01:18.949655 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.949630    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-mh6fv"]
Jul 17 11:01:18.953189 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:18.953167    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-mh6fv"]
Jul 17 11:01:19.680513 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:19.680484    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf" path="/var/lib/kubelet/pods/fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf/volumes"
Jul 17 11:01:26.435882 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:26.435842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:26.962584 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:26.962545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:27.061820 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:27.061778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:29.691828 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:29.691793    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:38.744846 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:38.744767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:39.051374 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.051243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:39.254992 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.254953    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f4b86c867-9skhq"]
Jul 17 11:01:39.255408 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.255390    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf" containerName="authorino"
Jul 17 11:01:39.255497 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.255411    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf" containerName="authorino"
Jul 17 11:01:39.255549 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.255516    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4134d3-6ea9-4caa-b6f3-e0cee74bdeaf" containerName="authorino"
Jul 17 11:01:39.260582 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.260554    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4b86c867-9skhq"
Jul 17 11:01:39.262483 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.262464    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f4b86c867-9skhq"]
Jul 17 11:01:39.284951 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.284925    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f4b86c867-9skhq"]
Jul 17 11:01:39.285271 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:01:39.285251    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jtdfn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5f4b86c867-9skhq" podUID="51255ba4-e953-4fb6-98b9-35304537a460"
Jul 17 11:01:39.312237 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.312176    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d8b58995f-bpm4l"]
Jul 17 11:01:39.314778 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.314762    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:01:39.317058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.317040    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 11:01:39.319356 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.319333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdfn\" (UniqueName: \"kubernetes.io/projected/51255ba4-e953-4fb6-98b9-35304537a460-kube-api-access-jtdfn\") pod \"authorino-5f4b86c867-9skhq\" (UID: \"51255ba4-e953-4fb6-98b9-35304537a460\") " pod="kuadrant-system/authorino-5f4b86c867-9skhq"
Jul 17 11:01:39.323770 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.323748    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d8b58995f-bpm4l"]
Jul 17 11:01:39.419884 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.419856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdfn\" (UniqueName: \"kubernetes.io/projected/51255ba4-e953-4fb6-98b9-35304537a460-kube-api-access-jtdfn\") pod \"authorino-5f4b86c867-9skhq\" (UID: \"51255ba4-e953-4fb6-98b9-35304537a460\") " pod="kuadrant-system/authorino-5f4b86c867-9skhq"
Jul 17 11:01:39.420034 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.419921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-tls-cert\") pod \"authorino-6d8b58995f-bpm4l\" (UID: \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\") " pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:01:39.420034 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.419948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdgz5\" (UniqueName: \"kubernetes.io/projected/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-kube-api-access-tdgz5\") pod \"authorino-6d8b58995f-bpm4l\" (UID: \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\") " pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:01:39.428092 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.428060    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdfn\" (UniqueName: \"kubernetes.io/projected/51255ba4-e953-4fb6-98b9-35304537a460-kube-api-access-jtdfn\") pod \"authorino-5f4b86c867-9skhq\" (UID: \"51255ba4-e953-4fb6-98b9-35304537a460\") " pod="kuadrant-system/authorino-5f4b86c867-9skhq"
Jul 17 11:01:39.520442 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.520408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-tls-cert\") pod \"authorino-6d8b58995f-bpm4l\" (UID: \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\") " pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:01:39.520442 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.520443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdgz5\" (UniqueName: \"kubernetes.io/projected/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-kube-api-access-tdgz5\") pod \"authorino-6d8b58995f-bpm4l\" (UID: \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\") " pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:01:39.522728 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.522701    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-tls-cert\") pod \"authorino-6d8b58995f-bpm4l\" (UID: \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\") " pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:01:39.528000 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.527981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdgz5\" (UniqueName: \"kubernetes.io/projected/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-kube-api-access-tdgz5\") pod \"authorino-6d8b58995f-bpm4l\" (UID: \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\") " pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:01:39.623960 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.623937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:01:39.757649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:39.757627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d8b58995f-bpm4l"]
Jul 17 11:01:39.760267 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:01:39.760241    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47898dc1_40d6_4ac3_b25a_7bc9f23fb639.slice/crio-c5b380bf17b7e098d74321e3ed25696d5f3cccd946d23a703e66e21b30b196f9 WatchSource:0}: Error finding container c5b380bf17b7e098d74321e3ed25696d5f3cccd946d23a703e66e21b30b196f9: Status 404 returned error can't find the container with id c5b380bf17b7e098d74321e3ed25696d5f3cccd946d23a703e66e21b30b196f9
Jul 17 11:01:40.024714 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:40.024632    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8b58995f-bpm4l" event={"ID":"47898dc1-40d6-4ac3-b25a-7bc9f23fb639","Type":"ContainerStarted","Data":"c5b380bf17b7e098d74321e3ed25696d5f3cccd946d23a703e66e21b30b196f9"}
Jul 17 11:01:40.024714 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:40.024648    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4b86c867-9skhq"
Jul 17 11:01:40.030783 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:40.030763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4b86c867-9skhq"
Jul 17 11:01:40.124936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:40.124907    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtdfn\" (UniqueName: \"kubernetes.io/projected/51255ba4-e953-4fb6-98b9-35304537a460-kube-api-access-jtdfn\") pod \"51255ba4-e953-4fb6-98b9-35304537a460\" (UID: \"51255ba4-e953-4fb6-98b9-35304537a460\") "
Jul 17 11:01:40.126935 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:40.126905    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51255ba4-e953-4fb6-98b9-35304537a460-kube-api-access-jtdfn" (OuterVolumeSpecName: "kube-api-access-jtdfn") pod "51255ba4-e953-4fb6-98b9-35304537a460" (UID: "51255ba4-e953-4fb6-98b9-35304537a460"). InnerVolumeSpecName "kube-api-access-jtdfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:01:40.226060 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:40.226023    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtdfn\" (UniqueName: \"kubernetes.io/projected/51255ba4-e953-4fb6-98b9-35304537a460-kube-api-access-jtdfn\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:01:41.035750 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.035662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4b86c867-9skhq"
Jul 17 11:01:41.035750 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.035678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8b58995f-bpm4l" event={"ID":"47898dc1-40d6-4ac3-b25a-7bc9f23fb639","Type":"ContainerStarted","Data":"ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c"}
Jul 17 11:01:41.053475 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.053431    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d8b58995f-bpm4l" podStartSLOduration=1.124207567 podStartE2EDuration="2.053417707s" totalImagesPullingTime="929.21014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:01:41.052542958 +0000 UTC m=+541.857568457" watchObservedRunningTime="2026-07-17 11:01:41.053417707 +0000 UTC m=+541.858443192"
Jul 17 11:01:41.081584 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.081547    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f4b86c867-9skhq"]
Jul 17 11:01:41.084351 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.084327    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7hbnt"]
Jul 17 11:01:41.084508 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.084490    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7hbnt" podUID="96af58e0-7ba1-461a-9062-a220456f7b33" containerName="authorino" containerID="cri-o://eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882" gracePeriod=30
Jul 17 11:01:41.089136 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.089115    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f4b86c867-9skhq"]
Jul 17 11:01:41.319308 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.319285    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7hbnt"
Jul 17 11:01:41.438125 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.438068    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpb48\" (UniqueName: \"kubernetes.io/projected/96af58e0-7ba1-461a-9062-a220456f7b33-kube-api-access-xpb48\") pod \"96af58e0-7ba1-461a-9062-a220456f7b33\" (UID: \"96af58e0-7ba1-461a-9062-a220456f7b33\") "
Jul 17 11:01:41.440050 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.440024    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96af58e0-7ba1-461a-9062-a220456f7b33-kube-api-access-xpb48" (OuterVolumeSpecName: "kube-api-access-xpb48") pod "96af58e0-7ba1-461a-9062-a220456f7b33" (UID: "96af58e0-7ba1-461a-9062-a220456f7b33"). InnerVolumeSpecName "kube-api-access-xpb48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:01:41.538920 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.538886    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpb48\" (UniqueName: \"kubernetes.io/projected/96af58e0-7ba1-461a-9062-a220456f7b33-kube-api-access-xpb48\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:01:41.679923 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:41.679888    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51255ba4-e953-4fb6-98b9-35304537a460" path="/var/lib/kubelet/pods/51255ba4-e953-4fb6-98b9-35304537a460/volumes"
Jul 17 11:01:42.040988 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.040897    2562 generic.go:356] "Generic (PLEG): container finished" podID="96af58e0-7ba1-461a-9062-a220456f7b33" containerID="eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882" exitCode=0
Jul 17 11:01:42.040988 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.040939    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7hbnt"
Jul 17 11:01:42.041498 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.040975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7hbnt" event={"ID":"96af58e0-7ba1-461a-9062-a220456f7b33","Type":"ContainerDied","Data":"eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882"}
Jul 17 11:01:42.041498 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.041021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7hbnt" event={"ID":"96af58e0-7ba1-461a-9062-a220456f7b33","Type":"ContainerDied","Data":"93ade78c0ebdab2781f783f19eff298792229e481b8520cc6350cd2cec83c736"}
Jul 17 11:01:42.041498 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.041041    2562 scope.go:117] "RemoveContainer" containerID="eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882"
Jul 17 11:01:42.049465 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.049454    2562 scope.go:117] "RemoveContainer" containerID="eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882"
Jul 17 11:01:42.049716 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:01:42.049698    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882\": container with ID starting with eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882 not found: ID does not exist" containerID="eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882"
Jul 17 11:01:42.049793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.049726    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882"} err="failed to get container status \"eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882\": rpc error: code = NotFound desc = could not find container \"eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882\": container with ID starting with eaa5f769dc9eb443f474c96aed29335a5ea48863071bf932a70a9079536b2882 not found: ID does not exist"
Jul 17 11:01:42.057533 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.057500    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7hbnt"]
Jul 17 11:01:42.059425 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:42.059406    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7hbnt"]
Jul 17 11:01:43.679863 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:43.679828    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96af58e0-7ba1-461a-9062-a220456f7b33" path="/var/lib/kubelet/pods/96af58e0-7ba1-461a-9062-a220456f7b33/volumes"
Jul 17 11:01:45.854941 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:45.854909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:46.021789 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:46.021758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:46.091829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:46.091802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:49.464428 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:49.464391    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:01:49.560663 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:01:49.560625    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:21.139315 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:21.139280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:21.232335 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:21.232304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:21.730150 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:21.730110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:21.889739 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:21.889710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:22.285769 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:22.285741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:22.388446 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:22.388414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:32.540774 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:32.540741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:32.639925 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:32.639885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:35.932033 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:35.931994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:52.979173 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:52.979131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:02:59.489068 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:02:59.489034    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:03:04.309034 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:04.308949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:03:06.039401 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:06.039355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:03:20.964120 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.964085    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"]
Jul 17 11:03:20.964614 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.964567    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96af58e0-7ba1-461a-9062-a220456f7b33" containerName="authorino"
Jul 17 11:03:20.964614 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.964592    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="96af58e0-7ba1-461a-9062-a220456f7b33" containerName="authorino"
Jul 17 11:03:20.964785 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.964712    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="96af58e0-7ba1-461a-9062-a220456f7b33" containerName="authorino"
Jul 17 11:03:20.968117 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.968088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:20.971812 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.971786    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 11:03:20.971812 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.971802    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 11:03:20.973101 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.973037    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 11:03:20.973260 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.973244    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-shjnc\""
Jul 17 11:03:20.979284 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:20.979263    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"]
Jul 17 11:03:21.031298 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.031267    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:03:21.109564 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.109532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.109731 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.109591    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp42v\" (UniqueName: \"kubernetes.io/projected/72223501-fa38-4bde-96df-5371402de82d-kube-api-access-vp42v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.109731 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.109679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.109731 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.109708    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72223501-fa38-4bde-96df-5371402de82d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.109856 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.109740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.109856 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.109766    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.210831 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.210785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.211028 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.210850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp42v\" (UniqueName: \"kubernetes.io/projected/72223501-fa38-4bde-96df-5371402de82d-kube-api-access-vp42v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.211028 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.210904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.211028 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.210922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72223501-fa38-4bde-96df-5371402de82d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.211028 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.210947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.211028 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.210974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.211335 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.211282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.211394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.211337    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.211394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.211347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.213239 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.213221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72223501-fa38-4bde-96df-5371402de82d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.213409 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.213392    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72223501-fa38-4bde-96df-5371402de82d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.223357 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.223294    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp42v\" (UniqueName: \"kubernetes.io/projected/72223501-fa38-4bde-96df-5371402de82d-kube-api-access-vp42v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f\" (UID: \"72223501-fa38-4bde-96df-5371402de82d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.279989 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.279958    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:21.413121 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.413096    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"]
Jul 17 11:03:21.414909 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:03:21.414887    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72223501_fa38_4bde_96df_5371402de82d.slice/crio-b4291711aac7c3ee66c96131f0e733034df970ef4407844e1774bc21448ff6f7 WatchSource:0}: Error finding container b4291711aac7c3ee66c96131f0e733034df970ef4407844e1774bc21448ff6f7: Status 404 returned error can't find the container with id b4291711aac7c3ee66c96131f0e733034df970ef4407844e1774bc21448ff6f7
Jul 17 11:03:21.416327 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.416307    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:03:21.491329 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:21.491247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f" event={"ID":"72223501-fa38-4bde-96df-5371402de82d","Type":"ContainerStarted","Data":"b4291711aac7c3ee66c96131f0e733034df970ef4407844e1774bc21448ff6f7"}
Jul 17 11:03:22.497666 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:22.497626    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f" event={"ID":"72223501-fa38-4bde-96df-5371402de82d","Type":"ContainerStarted","Data":"3b010f2515549ca8ee9ac2f5fe0eaf0317a1a2655ae109abfcda15187261a46a"}
Jul 17 11:03:22.529278 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:22.529179    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f" podStartSLOduration=1.521937131 podStartE2EDuration="2.529158663s" totalImagesPullingTime="1.007221532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:03:22.528508083 +0000 UTC m=+643.333533569" watchObservedRunningTime="2026-07-17 11:03:22.529158663 +0000 UTC m=+643.334184149"
Jul 17 11:03:31.280819 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:31.280786    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:31.281234 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:31.280841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:31.293396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:31.293373    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:31.445763 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:31.445718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:03:31.550529 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:31.550446    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f"
Jul 17 11:03:37.306040 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.306002    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"]
Jul 17 11:03:37.309415 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.309393    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.312653 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.312624    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 17 11:03:37.325884 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.325849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"]
Jul 17 11:03:37.356607 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.356567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:03:37.457430 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.457392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.457591 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.457446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.457591 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.457468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xpll\" (UniqueName: \"kubernetes.io/projected/8c02a705-e17f-4a38-984a-95925fa9315b-kube-api-access-6xpll\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.457667 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.457605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.457667 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.457652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.457736 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.457721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c02a705-e17f-4a38-984a-95925fa9315b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.558697 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.558602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.558697 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.558639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.558697 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.558673    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c02a705-e17f-4a38-984a-95925fa9315b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.558978 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.558708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.558978 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.558740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.558978 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.558772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xpll\" (UniqueName: \"kubernetes.io/projected/8c02a705-e17f-4a38-984a-95925fa9315b-kube-api-access-6xpll\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.559155 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.559130    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.559209 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.559179    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.559265 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.559251    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.561040 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.561009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c02a705-e17f-4a38-984a-95925fa9315b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.561298 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.561273    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c02a705-e17f-4a38-984a-95925fa9315b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.566916 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.566892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xpll\" (UniqueName: \"kubernetes.io/projected/8c02a705-e17f-4a38-984a-95925fa9315b-kube-api-access-6xpll\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r\" (UID: \"8c02a705-e17f-4a38-984a-95925fa9315b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.618581 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.618553    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:37.751183 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:37.751147    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"]
Jul 17 11:03:37.754457 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:03:37.754431    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c02a705_e17f_4a38_984a_95925fa9315b.slice/crio-5fa74cff75b7d18f751958ce922f57ea2edb2fe7e2bf49821b46c2f3b1744120 WatchSource:0}: Error finding container 5fa74cff75b7d18f751958ce922f57ea2edb2fe7e2bf49821b46c2f3b1744120: Status 404 returned error can't find the container with id 5fa74cff75b7d18f751958ce922f57ea2edb2fe7e2bf49821b46c2f3b1744120
Jul 17 11:03:38.573708 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:38.573675    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r" event={"ID":"8c02a705-e17f-4a38-984a-95925fa9315b","Type":"ContainerStarted","Data":"2ef952ebab5123a806a798cb3327a290438256100f3aa49d7821b34e8a5a002c"}
Jul 17 11:03:38.573708 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:38.573714    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r" event={"ID":"8c02a705-e17f-4a38-984a-95925fa9315b","Type":"ContainerStarted","Data":"5fa74cff75b7d18f751958ce922f57ea2edb2fe7e2bf49821b46c2f3b1744120"}
Jul 17 11:03:38.594029 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:38.593981    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r" podStartSLOduration=1.33584603 podStartE2EDuration="1.593967261s" totalImagesPullingTime="258.121231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:03:38.592261638 +0000 UTC m=+659.397287160" watchObservedRunningTime="2026-07-17 11:03:38.593967261 +0000 UTC m=+659.398992746"
Jul 17 11:03:39.845269 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:39.845237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:03:39.903835 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:39.903790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:03:47.618909 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:47.618873    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:47.619493 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:47.619117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:47.632279 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:47.632254    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:03:48.634386 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:03:48.634359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r"
Jul 17 11:04:21.412172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:21.412135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:04:30.405477 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.405379    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f7b68cbd6-vj8z4"]
Jul 17 11:04:30.407959 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.407940    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4"
Jul 17 11:04:30.421193 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.421170    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f7b68cbd6-vj8z4"]
Jul 17 11:04:30.452225 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.452194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96af127d-65b3-4cc5-9aa7-869689f0549c-tls-cert\") pod \"authorino-5f7b68cbd6-vj8z4\" (UID: \"96af127d-65b3-4cc5-9aa7-869689f0549c\") " pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4"
Jul 17 11:04:30.452360 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.452229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q87s\" (UniqueName: \"kubernetes.io/projected/96af127d-65b3-4cc5-9aa7-869689f0549c-kube-api-access-5q87s\") pod \"authorino-5f7b68cbd6-vj8z4\" (UID: \"96af127d-65b3-4cc5-9aa7-869689f0549c\") " pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4"
Jul 17 11:04:30.552707 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.552676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96af127d-65b3-4cc5-9aa7-869689f0549c-tls-cert\") pod \"authorino-5f7b68cbd6-vj8z4\" (UID: \"96af127d-65b3-4cc5-9aa7-869689f0549c\") " pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4"
Jul 17 11:04:30.552848 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.552712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q87s\" (UniqueName: \"kubernetes.io/projected/96af127d-65b3-4cc5-9aa7-869689f0549c-kube-api-access-5q87s\") pod \"authorino-5f7b68cbd6-vj8z4\" (UID: \"96af127d-65b3-4cc5-9aa7-869689f0549c\") " pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4"
Jul 17 11:04:30.555071 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.555046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96af127d-65b3-4cc5-9aa7-869689f0549c-tls-cert\") pod \"authorino-5f7b68cbd6-vj8z4\" (UID: \"96af127d-65b3-4cc5-9aa7-869689f0549c\") " pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4"
Jul 17 11:04:30.565698 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.565678    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q87s\" (UniqueName: \"kubernetes.io/projected/96af127d-65b3-4cc5-9aa7-869689f0549c-kube-api-access-5q87s\") pod \"authorino-5f7b68cbd6-vj8z4\" (UID: \"96af127d-65b3-4cc5-9aa7-869689f0549c\") " pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4"
Jul 17 11:04:30.716767 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.716694    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4"
Jul 17 11:04:30.860964 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.860931    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f7b68cbd6-vj8z4"]
Jul 17 11:04:30.863985 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:04:30.863953    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96af127d_65b3_4cc5_9aa7_869689f0549c.slice/crio-8ee59b1b5b722c1472944773ec2ed10392e37703da55918b221c5c20633ce358 WatchSource:0}: Error finding container 8ee59b1b5b722c1472944773ec2ed10392e37703da55918b221c5c20633ce358: Status 404 returned error can't find the container with id 8ee59b1b5b722c1472944773ec2ed10392e37703da55918b221c5c20633ce358
Jul 17 11:04:30.883049 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:30.883023    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:04:31.027853 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:31.027763    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:04:31.824985 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:31.824891    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4" event={"ID":"96af127d-65b3-4cc5-9aa7-869689f0549c","Type":"ContainerStarted","Data":"7ffe78ed291f6fb66dfb0988c977943b5a54a0db9ebdbc2be582e98d6753501d"}
Jul 17 11:04:31.824985 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:31.824949    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4" event={"ID":"96af127d-65b3-4cc5-9aa7-869689f0549c","Type":"ContainerStarted","Data":"8ee59b1b5b722c1472944773ec2ed10392e37703da55918b221c5c20633ce358"}
Jul 17 11:04:31.902382 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:31.902318    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f7b68cbd6-vj8z4" podStartSLOduration=1.220096029 podStartE2EDuration="1.902296707s" totalImagesPullingTime="682.200678ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:04:31.855816233 +0000 UTC m=+712.660841719" watchObservedRunningTime="2026-07-17 11:04:31.902296707 +0000 UTC m=+712.707322195"
Jul 17 11:04:31.903619 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:31.903592    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d8b58995f-bpm4l"]
Jul 17 11:04:31.903867 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:31.903841    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6d8b58995f-bpm4l" podUID="47898dc1-40d6-4ac3-b25a-7bc9f23fb639" containerName="authorino" containerID="cri-o://ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c" gracePeriod=30
Jul 17 11:04:32.058012 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.057975    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:04:32.168085 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.168046    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:04:32.265508 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.265476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:04:32.268364 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.268344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdgz5\" (UniqueName: \"kubernetes.io/projected/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-kube-api-access-tdgz5\") pod \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\" (UID: \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\") "
Jul 17 11:04:32.268450 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.268414    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-tls-cert\") pod \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\" (UID: \"47898dc1-40d6-4ac3-b25a-7bc9f23fb639\") "
Jul 17 11:04:32.270482 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.270456    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-kube-api-access-tdgz5" (OuterVolumeSpecName: "kube-api-access-tdgz5") pod "47898dc1-40d6-4ac3-b25a-7bc9f23fb639" (UID: "47898dc1-40d6-4ac3-b25a-7bc9f23fb639"). InnerVolumeSpecName "kube-api-access-tdgz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:04:32.279061 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.279032    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "47898dc1-40d6-4ac3-b25a-7bc9f23fb639" (UID: "47898dc1-40d6-4ac3-b25a-7bc9f23fb639"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:04:32.369523 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.369488    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdgz5\" (UniqueName: \"kubernetes.io/projected/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-kube-api-access-tdgz5\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:04:32.369523 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.369520    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/47898dc1-40d6-4ac3-b25a-7bc9f23fb639-tls-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:04:32.830537 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.830441    2562 generic.go:356] "Generic (PLEG): container finished" podID="47898dc1-40d6-4ac3-b25a-7bc9f23fb639" containerID="ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c" exitCode=0
Jul 17 11:04:32.830537 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.830497    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d8b58995f-bpm4l"
Jul 17 11:04:32.830982 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.830530    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8b58995f-bpm4l" event={"ID":"47898dc1-40d6-4ac3-b25a-7bc9f23fb639","Type":"ContainerDied","Data":"ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c"}
Jul 17 11:04:32.830982 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.830574    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d8b58995f-bpm4l" event={"ID":"47898dc1-40d6-4ac3-b25a-7bc9f23fb639","Type":"ContainerDied","Data":"c5b380bf17b7e098d74321e3ed25696d5f3cccd946d23a703e66e21b30b196f9"}
Jul 17 11:04:32.830982 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.830593    2562 scope.go:117] "RemoveContainer" containerID="ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c"
Jul 17 11:04:32.839895 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.839874    2562 scope.go:117] "RemoveContainer" containerID="ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c"
Jul 17 11:04:32.840170 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:04:32.840147    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c\": container with ID starting with ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c not found: ID does not exist" containerID="ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c"
Jul 17 11:04:32.840255 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.840182    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c"} err="failed to get container status \"ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c\": rpc error: code = NotFound desc = could not find container \"ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c\": container with ID starting with ab422007692e11adb8c7587d77d69b57a117290fcf7bc9ce7a14973a058d153c not found: ID does not exist"
Jul 17 11:04:32.867506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.867474    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d8b58995f-bpm4l"]
Jul 17 11:04:32.873358 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:32.873331    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d8b58995f-bpm4l"]
Jul 17 11:04:33.681937 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:33.681904    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47898dc1-40d6-4ac3-b25a-7bc9f23fb639" path="/var/lib/kubelet/pods/47898dc1-40d6-4ac3-b25a-7bc9f23fb639/volumes"
Jul 17 11:04:38.923544 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:04:38.923507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:05:42.565468 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:05:42.565434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:06:38.217573 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:06:38.217533    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:06:39.439711 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:06:39.439676    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:06:46.286342 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:06:46.286305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:14.173392 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:14.173347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:14.270178 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:14.270141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:14.396649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:14.396612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:20.503915 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:20.503878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:20.608779 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:20.608743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:20.702397 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:20.702356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:20.871994 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:20.871966    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:26.941976 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:26.941934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:07:27.021152 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:07:27.021124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:08:04.198540 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:08:04.198504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:08:05.955574 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:08:05.955537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:09:00.087975 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:09:00.087942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:09:32.297921 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:09:32.297877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:14:55.640493 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:14:55.640456    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:14:57.190540 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:14:57.190506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:15:00.155263 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.155226    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt"]
Jul 17 11:15:00.155810 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.155790    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47898dc1-40d6-4ac3-b25a-7bc9f23fb639" containerName="authorino"
Jul 17 11:15:00.155853 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.155815    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="47898dc1-40d6-4ac3-b25a-7bc9f23fb639" containerName="authorino"
Jul 17 11:15:00.155928 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.155916    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="47898dc1-40d6-4ac3-b25a-7bc9f23fb639" containerName="authorino"
Jul 17 11:15:00.159318 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.159301    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt"
Jul 17 11:15:00.162829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.162803    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:15:00.169777 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.169757    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt"
Jul 17 11:15:00.174750 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.174719    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt"]
Jul 17 11:15:00.313003 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.312964    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt"]
Jul 17 11:15:00.316395 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:15:00.316362    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2afdf2_fa38_4aa1_b580_f17fdd9a37a8.slice/crio-ed9f2cf2769bf8ffb27923d83de00e8cbfb8eba57947a687c2a7e6177be965ba WatchSource:0}: Error finding container ed9f2cf2769bf8ffb27923d83de00e8cbfb8eba57947a687c2a7e6177be965ba: Status 404 returned error can't find the container with id ed9f2cf2769bf8ffb27923d83de00e8cbfb8eba57947a687c2a7e6177be965ba
Jul 17 11:15:00.318372 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.318356    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:15:00.766038 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:00.766005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt" event={"ID":"ee2afdf2-fa38-4aa1-b580-f17fdd9a37a8","Type":"ContainerStarted","Data":"ed9f2cf2769bf8ffb27923d83de00e8cbfb8eba57947a687c2a7e6177be965ba"}
Jul 17 11:15:03.781904 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:03.781806    2562 generic.go:356] "Generic (PLEG): container finished" podID="ee2afdf2-fa38-4aa1-b580-f17fdd9a37a8" containerID="d13bd45195aca7651dc87f7e4e59af1baa58502b177f88cc573f3eb9e806e942" exitCode=0
Jul 17 11:15:03.782297 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:03.781894    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt" event={"ID":"ee2afdf2-fa38-4aa1-b580-f17fdd9a37a8","Type":"ContainerDied","Data":"d13bd45195aca7651dc87f7e4e59af1baa58502b177f88cc573f3eb9e806e942"}
Jul 17 11:15:04.920778 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:04.920754    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt"
Jul 17 11:15:05.793672 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:05.793633    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt" event={"ID":"ee2afdf2-fa38-4aa1-b580-f17fdd9a37a8","Type":"ContainerDied","Data":"ed9f2cf2769bf8ffb27923d83de00e8cbfb8eba57947a687c2a7e6177be965ba"}
Jul 17 11:15:05.793871 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:05.793681    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738115-xndtt"
Jul 17 11:15:05.793871 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:05.793712    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed9f2cf2769bf8ffb27923d83de00e8cbfb8eba57947a687c2a7e6177be965ba"
Jul 17 11:15:17.392057 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:17.392012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:15:57.654706 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:15:57.654671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:17:17.389331 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:17:17.389288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:17:42.551557 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:17:42.551504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:10.136032 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:10.135989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:10.221875 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:10.221838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:10.583452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:10.583367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:16.380734 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.380661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:16.484948 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.484916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:16.582458 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.582420    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"]
Jul 17 11:18:16.582852 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.582838    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee2afdf2-fa38-4aa1-b580-f17fdd9a37a8" containerName="cleanup"
Jul 17 11:18:16.582898 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.582855    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee2afdf2-fa38-4aa1-b580-f17fdd9a37a8" containerName="cleanup"
Jul 17 11:18:16.582935 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.582926    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee2afdf2-fa38-4aa1-b580-f17fdd9a37a8" containerName="cleanup"
Jul 17 11:18:16.585810 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.585791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.588236 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.588216    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0839e276-openshift-default-dockercfg-5p979\""
Jul 17 11:18:16.610486 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.610455    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"]
Jul 17 11:18:16.634214 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.634123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:16.700220 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.700180    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:16.765564 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-envoy\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.765564 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istiod-ca-cert\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.765789 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-data\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.765789 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lspxt\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-kube-api-access-lspxt\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.765789 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-credential-socket\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.765789 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-certs\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.765916 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-socket\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.765916 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-podinfo\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.765916 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.765845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-token\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.866921 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.866875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-token\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.866978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-envoy\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istiod-ca-cert\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-data\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lspxt\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-kube-api-access-lspxt\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867387 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-credential-socket\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867387 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-certs\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867497 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-socket\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867497 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-podinfo\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867604 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-credential-socket\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867663 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867606    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-certs\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867715 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-data\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867792 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istiod-ca-cert\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.867846 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.867773    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-socket\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.869399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.869376    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-envoy\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.869763 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.869741    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-podinfo\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.879551 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.879521    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-token\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.880242 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.880222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lspxt\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-kube-api-access-lspxt\") pod \"e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") " pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:16.896838 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:16.896771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:17.041345 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.041248    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"]
Jul 17 11:18:17.043484 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:18:17.043459    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8881f480_ebd5_49c8_80e1_fa8a0d1a130e.slice/crio-27fea5602bde05ab59b657dab75073d15bb21c94ac3c7609deae594b84fb9a87 WatchSource:0}: Error finding container 27fea5602bde05ab59b657dab75073d15bb21c94ac3c7609deae594b84fb9a87: Status 404 returned error can't find the container with id 27fea5602bde05ab59b657dab75073d15bb21c94ac3c7609deae594b84fb9a87
Jul 17 11:18:17.045501 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.045468    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:18:17.045582 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.045532    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:18:17.045582 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.045563    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:18:17.702837 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.702799    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" event={"ID":"8881f480-ebd5-49c8-80e1-fa8a0d1a130e","Type":"ContainerStarted","Data":"973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d"}
Jul 17 11:18:17.703253 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.702856    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" event={"ID":"8881f480-ebd5-49c8-80e1-fa8a0d1a130e","Type":"ContainerStarted","Data":"27fea5602bde05ab59b657dab75073d15bb21c94ac3c7609deae594b84fb9a87"}
Jul 17 11:18:17.755369 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.755315    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" podStartSLOduration=1.755299779 podStartE2EDuration="1.755299779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:18:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:18:17.753652289 +0000 UTC m=+1538.558677774" watchObservedRunningTime="2026-07-17 11:18:17.755299779 +0000 UTC m=+1538.560325263"
Jul 17 11:18:17.843400 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.843348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:17.897439 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.897411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:17.937393 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:17.937363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:18.019155 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:18.019024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:18.310211 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:18.310129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:18.604311 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:18.604211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:18.707375 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:18.707346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:18.903156 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:18.903128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:19.712107 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:19.712047    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:19.713020 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:19.713001    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:20.279666 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:20.279629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:18:22.808578 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:22.808544    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"]
Jul 17 11:18:22.812265 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:22.812249    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"
Jul 17 11:18:22.815249 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:22.815221    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:18:22.815735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:22.815715    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:18:22.820749 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:22.820723    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"]
Jul 17 11:18:22.824863 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:22.824814    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0424fa-0932-4f42-b565-8b2728e0769e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-dgzhm\" (UID: \"af0424fa-0932-4f42-b565-8b2728e0769e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"
Jul 17 11:18:22.926170 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:22.926134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0424fa-0932-4f42-b565-8b2728e0769e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-dgzhm\" (UID: \"af0424fa-0932-4f42-b565-8b2728e0769e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"
Jul 17 11:18:22.926726 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:22.926707    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0424fa-0932-4f42-b565-8b2728e0769e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-dgzhm\" (UID: \"af0424fa-0932-4f42-b565-8b2728e0769e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"
Jul 17 11:18:23.129492 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:23.129460    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"
Jul 17 11:18:23.279769 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:23.279741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"]
Jul 17 11:18:23.282466 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:18:23.282438    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0424fa_0932_4f42_b565_8b2728e0769e.slice/crio-db563f6a449c3a27bb79e234bbfbac3f46dd6bb9cacaea8d308d1297bd57ba7e WatchSource:0}: Error finding container db563f6a449c3a27bb79e234bbfbac3f46dd6bb9cacaea8d308d1297bd57ba7e: Status 404 returned error can't find the container with id db563f6a449c3a27bb79e234bbfbac3f46dd6bb9cacaea8d308d1297bd57ba7e
Jul 17 11:18:23.731368 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:23.731276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" event={"ID":"af0424fa-0932-4f42-b565-8b2728e0769e","Type":"ContainerStarted","Data":"d3fb6e86b2053ae25210aaf317421d0d8097f9e00105c4b7990cb3d9b6e70fea"}
Jul 17 11:18:23.731368 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:23.731331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" event={"ID":"af0424fa-0932-4f42-b565-8b2728e0769e","Type":"ContainerStarted","Data":"db563f6a449c3a27bb79e234bbfbac3f46dd6bb9cacaea8d308d1297bd57ba7e"}
Jul 17 11:18:23.750459 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:23.750402    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" podStartSLOduration=1.750386118 podStartE2EDuration="1.750386118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:18:23.749683396 +0000 UTC m=+1544.554708883" watchObservedRunningTime="2026-07-17 11:18:23.750386118 +0000 UTC m=+1544.555411600"
Jul 17 11:18:24.737506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:24.737469    2562 generic.go:356] "Generic (PLEG): container finished" podID="af0424fa-0932-4f42-b565-8b2728e0769e" containerID="d3fb6e86b2053ae25210aaf317421d0d8097f9e00105c4b7990cb3d9b6e70fea" exitCode=7
Jul 17 11:18:24.737933 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:24.737561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" event={"ID":"af0424fa-0932-4f42-b565-8b2728e0769e","Type":"ContainerDied","Data":"d3fb6e86b2053ae25210aaf317421d0d8097f9e00105c4b7990cb3d9b6e70fea"}
Jul 17 11:18:24.737933 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:24.737780    2562 scope.go:117] "RemoveContainer" containerID="d3fb6e86b2053ae25210aaf317421d0d8097f9e00105c4b7990cb3d9b6e70fea"
Jul 17 11:18:25.744136 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:25.744098    2562 generic.go:356] "Generic (PLEG): container finished" podID="af0424fa-0932-4f42-b565-8b2728e0769e" containerID="75b79a08142b53a7fd82ffec7c76e16f628cf7196cbc00c740e00c311909d22a" exitCode=7
Jul 17 11:18:25.744557 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:25.744184    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" event={"ID":"af0424fa-0932-4f42-b565-8b2728e0769e","Type":"ContainerDied","Data":"75b79a08142b53a7fd82ffec7c76e16f628cf7196cbc00c740e00c311909d22a"}
Jul 17 11:18:25.744557 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:25.744246    2562 scope.go:117] "RemoveContainer" containerID="d3fb6e86b2053ae25210aaf317421d0d8097f9e00105c4b7990cb3d9b6e70fea"
Jul 17 11:18:25.744557 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:25.744489    2562 scope.go:117] "RemoveContainer" containerID="75b79a08142b53a7fd82ffec7c76e16f628cf7196cbc00c740e00c311909d22a"
Jul 17 11:18:25.744783 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:18:25.744747    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-dgzhm_odh-ai-gateway-infra(af0424fa-0932-4f42-b565-8b2728e0769e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" podUID="af0424fa-0932-4f42-b565-8b2728e0769e"
Jul 17 11:18:26.750608 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:26.750570    2562 scope.go:117] "RemoveContainer" containerID="75b79a08142b53a7fd82ffec7c76e16f628cf7196cbc00c740e00c311909d22a"
Jul 17 11:18:26.751251 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:18:26.750817    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-dgzhm_odh-ai-gateway-infra(af0424fa-0932-4f42-b565-8b2728e0769e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" podUID="af0424fa-0932-4f42-b565-8b2728e0769e"
Jul 17 11:18:34.714117 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:34.714054    2562 patch_prober.go:28] interesting pod/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 17 11:18:34.714532 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:34.714141    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 17 11:18:34.789811 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:34.789777    2562 generic.go:356] "Generic (PLEG): container finished" podID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerID="973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d" exitCode=0
Jul 17 11:18:34.789977 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:34.789853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" event={"ID":"8881f480-ebd5-49c8-80e1-fa8a0d1a130e","Type":"ContainerDied","Data":"973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d"}
Jul 17 11:18:34.790429 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:34.790411    2562 scope.go:117] "RemoveContainer" containerID="973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d"
Jul 17 11:18:34.791490 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:34.791457    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:18:34.791574 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:34.791545    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:18:34.791614 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:34.791600    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:18:35.799389 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:35.799349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" event={"ID":"8881f480-ebd5-49c8-80e1-fa8a0d1a130e","Type":"ContainerStarted","Data":"152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11"}
Jul 17 11:18:35.897457 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:35.897417    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:35.897647 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:35.897618    2562 patch_prober.go:28] interesting pod/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 17 11:18:35.897698 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:35.897670    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 17 11:18:36.897702 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:36.897665    2562 patch_prober.go:28] interesting pod/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 17 11:18:36.898123 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:36.897733    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 17 11:18:37.897200 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:37.897166    2562 patch_prober.go:28] interesting pod/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 17 11:18:37.897378 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:37.897224    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 17 11:18:38.898029 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:38.897995    2562 patch_prober.go:28] interesting pod/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 17 11:18:38.898452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:38.898068    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 17 11:18:39.677421 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:39.677390    2562 scope.go:117] "RemoveContainer" containerID="75b79a08142b53a7fd82ffec7c76e16f628cf7196cbc00c740e00c311909d22a"
Jul 17 11:18:39.901497 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:39.901467    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:39.901903 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:39.901760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:39.902536 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:39.902518    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:18:40.825759 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:40.825725    2562 generic.go:356] "Generic (PLEG): container finished" podID="af0424fa-0932-4f42-b565-8b2728e0769e" containerID="9fb79ff0e08a7ad3413b49cc60f9636af08cdae8c5a11b28f49aab1cb6f2f802" exitCode=7
Jul 17 11:18:40.825936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:40.825799    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" event={"ID":"af0424fa-0932-4f42-b565-8b2728e0769e","Type":"ContainerDied","Data":"9fb79ff0e08a7ad3413b49cc60f9636af08cdae8c5a11b28f49aab1cb6f2f802"}
Jul 17 11:18:40.825936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:40.825859    2562 scope.go:117] "RemoveContainer" containerID="75b79a08142b53a7fd82ffec7c76e16f628cf7196cbc00c740e00c311909d22a"
Jul 17 11:18:40.826319 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:40.826295    2562 scope.go:117] "RemoveContainer" containerID="9fb79ff0e08a7ad3413b49cc60f9636af08cdae8c5a11b28f49aab1cb6f2f802"
Jul 17 11:18:40.826550 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:18:40.826519    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-dgzhm_odh-ai-gateway-infra(af0424fa-0932-4f42-b565-8b2728e0769e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" podUID="af0424fa-0932-4f42-b565-8b2728e0769e"
Jul 17 11:18:41.854986 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:41.854952    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"]
Jul 17 11:18:41.991285 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:41.991256    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"
Jul 17 11:18:42.107974 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:42.107944    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0424fa-0932-4f42-b565-8b2728e0769e-maas-api-service-ca\") pod \"af0424fa-0932-4f42-b565-8b2728e0769e\" (UID: \"af0424fa-0932-4f42-b565-8b2728e0769e\") "
Jul 17 11:18:42.108340 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:42.108318    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0424fa-0932-4f42-b565-8b2728e0769e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af0424fa-0932-4f42-b565-8b2728e0769e" (UID: "af0424fa-0932-4f42-b565-8b2728e0769e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:18:42.209175 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:42.209134    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af0424fa-0932-4f42-b565-8b2728e0769e-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:18:42.839090 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:42.839055    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"
Jul 17 11:18:42.839288 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:42.839055    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm" event={"ID":"af0424fa-0932-4f42-b565-8b2728e0769e","Type":"ContainerDied","Data":"db563f6a449c3a27bb79e234bbfbac3f46dd6bb9cacaea8d308d1297bd57ba7e"}
Jul 17 11:18:42.839288 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:42.839203    2562 scope.go:117] "RemoveContainer" containerID="9fb79ff0e08a7ad3413b49cc60f9636af08cdae8c5a11b28f49aab1cb6f2f802"
Jul 17 11:18:42.859908 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:42.859883    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"]
Jul 17 11:18:42.863701 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:42.863642    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-dgzhm"]
Jul 17 11:18:43.679999 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:18:43.679965    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" path="/var/lib/kubelet/pods/af0424fa-0932-4f42-b565-8b2728e0769e/volumes"
Jul 17 11:19:22.871097 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.871048    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"]
Jul 17 11:19:22.871601 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.871421    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:19:22.871601 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.871432    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:19:22.871601 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.871460    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:19:22.871601 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.871465    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:19:22.871601 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.871523    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:19:22.871601 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.871531    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:19:22.871601 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.871537    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:19:22.873597 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.873580    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"
Jul 17 11:19:22.876236 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.876213    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:19:22.876368 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.876216    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:19:22.883053 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.883028    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"]
Jul 17 11:19:22.987101 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:22.987020    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54a528d-b9b8-4139-bc45-4f6210c5728b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-kj2ph\" (UID: \"d54a528d-b9b8-4139-bc45-4f6210c5728b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"
Jul 17 11:19:23.088439 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:23.088388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54a528d-b9b8-4139-bc45-4f6210c5728b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-kj2ph\" (UID: \"d54a528d-b9b8-4139-bc45-4f6210c5728b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"
Jul 17 11:19:23.089038 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:23.089017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54a528d-b9b8-4139-bc45-4f6210c5728b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-kj2ph\" (UID: \"d54a528d-b9b8-4139-bc45-4f6210c5728b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"
Jul 17 11:19:23.185515 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:23.185434    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"
Jul 17 11:19:23.323322 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:23.323281    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"]
Jul 17 11:19:23.325664 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:19:23.325633    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54a528d_b9b8_4139_bc45_4f6210c5728b.slice/crio-4f74654e9838cebd28e23a375b4844f23940d64e625df638213cf81b9a1fab85 WatchSource:0}: Error finding container 4f74654e9838cebd28e23a375b4844f23940d64e625df638213cf81b9a1fab85: Status 404 returned error can't find the container with id 4f74654e9838cebd28e23a375b4844f23940d64e625df638213cf81b9a1fab85
Jul 17 11:19:24.035980 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:24.035950    2562 generic.go:356] "Generic (PLEG): container finished" podID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerID="3512de5bfaa80328e13a2f68dff666a15ed28020f78c2dd94f9971ff6e35f0e3" exitCode=7
Jul 17 11:19:24.036415 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:24.035997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" event={"ID":"d54a528d-b9b8-4139-bc45-4f6210c5728b","Type":"ContainerDied","Data":"3512de5bfaa80328e13a2f68dff666a15ed28020f78c2dd94f9971ff6e35f0e3"}
Jul 17 11:19:24.036415 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:24.036034    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" event={"ID":"d54a528d-b9b8-4139-bc45-4f6210c5728b","Type":"ContainerStarted","Data":"4f74654e9838cebd28e23a375b4844f23940d64e625df638213cf81b9a1fab85"}
Jul 17 11:19:24.036415 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:24.036241    2562 scope.go:117] "RemoveContainer" containerID="3512de5bfaa80328e13a2f68dff666a15ed28020f78c2dd94f9971ff6e35f0e3"
Jul 17 11:19:25.043402 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:25.043306    2562 generic.go:356] "Generic (PLEG): container finished" podID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerID="bfcd75bf864f040d8198c6d510fabb72d904c59bc79bcbdb175152b02a59f7b5" exitCode=7
Jul 17 11:19:25.043786 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:25.043392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" event={"ID":"d54a528d-b9b8-4139-bc45-4f6210c5728b","Type":"ContainerDied","Data":"bfcd75bf864f040d8198c6d510fabb72d904c59bc79bcbdb175152b02a59f7b5"}
Jul 17 11:19:25.043786 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:25.043481    2562 scope.go:117] "RemoveContainer" containerID="3512de5bfaa80328e13a2f68dff666a15ed28020f78c2dd94f9971ff6e35f0e3"
Jul 17 11:19:25.043786 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:25.043737    2562 scope.go:117] "RemoveContainer" containerID="bfcd75bf864f040d8198c6d510fabb72d904c59bc79bcbdb175152b02a59f7b5"
Jul 17 11:19:25.043962 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:19:25.043942    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-kj2ph_odh-ai-gateway-infra(d54a528d-b9b8-4139-bc45-4f6210c5728b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b"
Jul 17 11:19:26.050174 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:26.050149    2562 scope.go:117] "RemoveContainer" containerID="bfcd75bf864f040d8198c6d510fabb72d904c59bc79bcbdb175152b02a59f7b5"
Jul 17 11:19:26.050576 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:19:26.050368    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-kj2ph_odh-ai-gateway-infra(d54a528d-b9b8-4139-bc45-4f6210c5728b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b"
Jul 17 11:19:41.675232 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:41.675196    2562 scope.go:117] "RemoveContainer" containerID="bfcd75bf864f040d8198c6d510fabb72d904c59bc79bcbdb175152b02a59f7b5"
Jul 17 11:19:42.128366 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:42.128329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" event={"ID":"d54a528d-b9b8-4139-bc45-4f6210c5728b","Type":"ContainerStarted","Data":"5fad5167f9cf54fcdd6326f766079a363c146172ef473d81596093a8b11fc19f"}
Jul 17 11:19:42.148577 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:42.148530    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" podStartSLOduration=20.148515543 podStartE2EDuration="20.148515543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:19:42.145653947 +0000 UTC m=+1622.950679431" watchObservedRunningTime="2026-07-17 11:19:42.148515543 +0000 UTC m=+1622.953541029"
Jul 17 11:19:43.135017 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:43.134983    2562 generic.go:356] "Generic (PLEG): container finished" podID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerID="5fad5167f9cf54fcdd6326f766079a363c146172ef473d81596093a8b11fc19f" exitCode=7
Jul 17 11:19:43.135452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:43.135055    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" event={"ID":"d54a528d-b9b8-4139-bc45-4f6210c5728b","Type":"ContainerDied","Data":"5fad5167f9cf54fcdd6326f766079a363c146172ef473d81596093a8b11fc19f"}
Jul 17 11:19:43.135452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:43.135140    2562 scope.go:117] "RemoveContainer" containerID="bfcd75bf864f040d8198c6d510fabb72d904c59bc79bcbdb175152b02a59f7b5"
Jul 17 11:19:43.135452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:43.135424    2562 scope.go:117] "RemoveContainer" containerID="5fad5167f9cf54fcdd6326f766079a363c146172ef473d81596093a8b11fc19f"
Jul 17 11:19:43.135658 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:19:43.135639    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-kj2ph_odh-ai-gateway-infra(d54a528d-b9b8-4139-bc45-4f6210c5728b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b"
Jul 17 11:19:43.167118 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:43.167072    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"]
Jul 17 11:19:44.282952 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:44.282927    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"
Jul 17 11:19:44.396122 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:44.396013    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54a528d-b9b8-4139-bc45-4f6210c5728b-maas-api-service-ca\") pod \"d54a528d-b9b8-4139-bc45-4f6210c5728b\" (UID: \"d54a528d-b9b8-4139-bc45-4f6210c5728b\") "
Jul 17 11:19:44.396464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:44.396441    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d54a528d-b9b8-4139-bc45-4f6210c5728b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d54a528d-b9b8-4139-bc45-4f6210c5728b" (UID: "d54a528d-b9b8-4139-bc45-4f6210c5728b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:19:44.497579 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:44.497535    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d54a528d-b9b8-4139-bc45-4f6210c5728b-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:19:45.147468 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:45.147429    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph" event={"ID":"d54a528d-b9b8-4139-bc45-4f6210c5728b","Type":"ContainerDied","Data":"4f74654e9838cebd28e23a375b4844f23940d64e625df638213cf81b9a1fab85"}
Jul 17 11:19:45.147468 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:45.147465    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"
Jul 17 11:19:45.147835 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:45.147535    2562 scope.go:117] "RemoveContainer" containerID="5fad5167f9cf54fcdd6326f766079a363c146172ef473d81596093a8b11fc19f"
Jul 17 11:19:45.173173 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:45.173142    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"]
Jul 17 11:19:45.179271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:45.179247    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-kj2ph"]
Jul 17 11:19:45.681046 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:19:45.681007    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" path="/var/lib/kubelet/pods/d54a528d-b9b8-4139-bc45-4f6210c5728b/volumes"
Jul 17 11:20:22.935362 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935328    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"]
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935691    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935704    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935712    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935718    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0424fa-0932-4f42-b565-8b2728e0769e" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935736    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935741    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935757    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935762    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935818    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:20:22.935829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.935830    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:20:22.937962 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.937946    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"
Jul 17 11:20:22.940488 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.940463    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:20:22.940629 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.940489    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:20:22.946031 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.945648    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"]
Jul 17 11:20:22.965545 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:22.965515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc377e35-26a0-4eff-baa0-4865e3a4d7e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-b8dmw\" (UID: \"dc377e35-26a0-4eff-baa0-4865e3a4d7e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"
Jul 17 11:20:23.066501 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:23.066460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc377e35-26a0-4eff-baa0-4865e3a4d7e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-b8dmw\" (UID: \"dc377e35-26a0-4eff-baa0-4865e3a4d7e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"
Jul 17 11:20:23.067104 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:23.067069    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc377e35-26a0-4eff-baa0-4865e3a4d7e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0839e276-b8dmw\" (UID: \"dc377e35-26a0-4eff-baa0-4865e3a4d7e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"
Jul 17 11:20:23.249850 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:23.249760    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"
Jul 17 11:20:23.382002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:23.381976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"]
Jul 17 11:20:23.384260 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:20:23.384227    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc377e35_26a0_4eff_baa0_4865e3a4d7e0.slice/crio-c8a2172a5efaa5918c551a634739d13883e7b5f2091cde0d9fd6195acf6997e8 WatchSource:0}: Error finding container c8a2172a5efaa5918c551a634739d13883e7b5f2091cde0d9fd6195acf6997e8: Status 404 returned error can't find the container with id c8a2172a5efaa5918c551a634739d13883e7b5f2091cde0d9fd6195acf6997e8
Jul 17 11:20:24.332662 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:24.332569    2562 generic.go:356] "Generic (PLEG): container finished" podID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerID="c0364a612f5a26ee80748b271a40daadb3ddb561bc277d5fb0ba161779fbf210" exitCode=7
Jul 17 11:20:24.332662 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:24.332635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw" event={"ID":"dc377e35-26a0-4eff-baa0-4865e3a4d7e0","Type":"ContainerDied","Data":"c0364a612f5a26ee80748b271a40daadb3ddb561bc277d5fb0ba161779fbf210"}
Jul 17 11:20:24.333056 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:24.332677    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw" event={"ID":"dc377e35-26a0-4eff-baa0-4865e3a4d7e0","Type":"ContainerStarted","Data":"c8a2172a5efaa5918c551a634739d13883e7b5f2091cde0d9fd6195acf6997e8"}
Jul 17 11:20:24.333056 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:24.332868    2562 scope.go:117] "RemoveContainer" containerID="c0364a612f5a26ee80748b271a40daadb3ddb561bc277d5fb0ba161779fbf210"
Jul 17 11:20:25.339582 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:25.339484    2562 generic.go:356] "Generic (PLEG): container finished" podID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerID="0d555ba612e2f24d8ad2af2c4212ae4bc33dde9b90608363cfc3ca239d85cb3e" exitCode=7
Jul 17 11:20:25.339582 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:25.339526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw" event={"ID":"dc377e35-26a0-4eff-baa0-4865e3a4d7e0","Type":"ContainerDied","Data":"0d555ba612e2f24d8ad2af2c4212ae4bc33dde9b90608363cfc3ca239d85cb3e"}
Jul 17 11:20:25.340042 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:25.339587    2562 scope.go:117] "RemoveContainer" containerID="c0364a612f5a26ee80748b271a40daadb3ddb561bc277d5fb0ba161779fbf210"
Jul 17 11:20:25.340042 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:25.339817    2562 scope.go:117] "RemoveContainer" containerID="0d555ba612e2f24d8ad2af2c4212ae4bc33dde9b90608363cfc3ca239d85cb3e"
Jul 17 11:20:25.340158 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:20:25.340070    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-b8dmw_odh-ai-gateway-infra(dc377e35-26a0-4eff-baa0-4865e3a4d7e0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0"
Jul 17 11:20:26.346354 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:26.346327    2562 scope.go:117] "RemoveContainer" containerID="0d555ba612e2f24d8ad2af2c4212ae4bc33dde9b90608363cfc3ca239d85cb3e"
Jul 17 11:20:26.346743 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:20:26.346524    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-b8dmw_odh-ai-gateway-infra(dc377e35-26a0-4eff-baa0-4865e3a4d7e0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0"
Jul 17 11:20:40.674454 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:40.674421    2562 scope.go:117] "RemoveContainer" containerID="0d555ba612e2f24d8ad2af2c4212ae4bc33dde9b90608363cfc3ca239d85cb3e"
Jul 17 11:20:41.419884 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:41.419842    2562 generic.go:356] "Generic (PLEG): container finished" podID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerID="7fd1943844d9d4f67bfe78fd498ca0c5ab5d313e799101743865e5ac7648e10d" exitCode=7
Jul 17 11:20:41.420057 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:41.419919    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw" event={"ID":"dc377e35-26a0-4eff-baa0-4865e3a4d7e0","Type":"ContainerDied","Data":"7fd1943844d9d4f67bfe78fd498ca0c5ab5d313e799101743865e5ac7648e10d"}
Jul 17 11:20:41.420057 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:41.419986    2562 scope.go:117] "RemoveContainer" containerID="0d555ba612e2f24d8ad2af2c4212ae4bc33dde9b90608363cfc3ca239d85cb3e"
Jul 17 11:20:41.420357 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:41.420341    2562 scope.go:117] "RemoveContainer" containerID="7fd1943844d9d4f67bfe78fd498ca0c5ab5d313e799101743865e5ac7648e10d"
Jul 17 11:20:41.420613 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:20:41.420591    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-0839e276-b8dmw_odh-ai-gateway-infra(dc377e35-26a0-4eff-baa0-4865e3a4d7e0)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0"
Jul 17 11:20:42.465508 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:42.465474    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"]
Jul 17 11:20:42.602299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:42.602274    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"
Jul 17 11:20:42.744602 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:42.744502    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc377e35-26a0-4eff-baa0-4865e3a4d7e0-maas-api-service-ca\") pod \"dc377e35-26a0-4eff-baa0-4865e3a4d7e0\" (UID: \"dc377e35-26a0-4eff-baa0-4865e3a4d7e0\") "
Jul 17 11:20:42.744869 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:42.744845    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc377e35-26a0-4eff-baa0-4865e3a4d7e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc377e35-26a0-4eff-baa0-4865e3a4d7e0" (UID: "dc377e35-26a0-4eff-baa0-4865e3a4d7e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:20:42.744923 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:42.744908    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc377e35-26a0-4eff-baa0-4865e3a4d7e0-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:20:43.432267 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:43.432239    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"
Jul 17 11:20:43.432267 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:43.432259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw" event={"ID":"dc377e35-26a0-4eff-baa0-4865e3a4d7e0","Type":"ContainerDied","Data":"c8a2172a5efaa5918c551a634739d13883e7b5f2091cde0d9fd6195acf6997e8"}
Jul 17 11:20:43.432511 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:43.432314    2562 scope.go:117] "RemoveContainer" containerID="7fd1943844d9d4f67bfe78fd498ca0c5ab5d313e799101743865e5ac7648e10d"
Jul 17 11:20:43.455982 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:43.455953    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"]
Jul 17 11:20:43.460984 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:43.460961    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0839e276-b8dmw"]
Jul 17 11:20:43.683692 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:20:43.683613    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" path="/var/lib/kubelet/pods/dc377e35-26a0-4eff-baa0-4865e3a4d7e0/volumes"
Jul 17 11:21:24.000958 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:24.000913    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"]
Jul 17 11:21:24.001603 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:24.001240    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy" containerID="cri-o://152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11" gracePeriod=30
Jul 17 11:21:24.071969 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:24.071930    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:24.904193 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:24.904158    2562 patch_prober.go:28] interesting pod/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 11:21:24.904365 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:24.904226    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 11:21:25.485209 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:25.485174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:29.262741 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.262713    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:21:29.378957 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.378930    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-envoy\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.378994    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istiod-ca-cert\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379034    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-certs\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379113    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lspxt\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-kube-api-access-lspxt\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379173    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-data\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379196    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-socket\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379226    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-podinfo\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379278    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-token\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379319    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-credential-socket\") pod \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\" (UID: \"8881f480-ebd5-49c8-80e1-fa8a0d1a130e\") "
Jul 17 11:21:29.379583 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379384    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:21:29.379583 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379486    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:21:29.379583 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379520    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:21:29.379770 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379707    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:21:29.379770 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379727    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istiod-ca-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.379890 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379770    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.379890 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.379792    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-workload-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.380141 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.380115    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-data" (OuterVolumeSpecName: "istio-data") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:21:29.381460 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.381418    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:21:29.381598 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.381577    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 11:21:29.381660 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.381623    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:21:29.381753 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.381734    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-kube-api-access-lspxt" (OuterVolumeSpecName: "kube-api-access-lspxt") pod "8881f480-ebd5-49c8-80e1-fa8a0d1a130e" (UID: "8881f480-ebd5-49c8-80e1-fa8a0d1a130e"). InnerVolumeSpecName "kube-api-access-lspxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:21:29.480506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.480460    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-credential-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.480506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.480496    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-envoy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.480506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.480506    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lspxt\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-kube-api-access-lspxt\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.480506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.480515    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-data\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.480506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.480524    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-podinfo\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.480873 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.480531    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8881f480-ebd5-49c8-80e1-fa8a0d1a130e-istio-token\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:21:29.650443 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.650405    2562 generic.go:356] "Generic (PLEG): container finished" podID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerID="152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11" exitCode=0
Jul 17 11:21:29.650656 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.650455    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"
Jul 17 11:21:29.650656 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.650497    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" event={"ID":"8881f480-ebd5-49c8-80e1-fa8a0d1a130e","Type":"ContainerDied","Data":"152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11"}
Jul 17 11:21:29.650656 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.650565    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn" event={"ID":"8881f480-ebd5-49c8-80e1-fa8a0d1a130e","Type":"ContainerDied","Data":"27fea5602bde05ab59b657dab75073d15bb21c94ac3c7609deae594b84fb9a87"}
Jul 17 11:21:29.650656 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.650597    2562 scope.go:117] "RemoveContainer" containerID="152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11"
Jul 17 11:21:29.666125 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.666100    2562 scope.go:117] "RemoveContainer" containerID="973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d"
Jul 17 11:21:29.674503 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.674484    2562 scope.go:117] "RemoveContainer" containerID="152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11"
Jul 17 11:21:29.674809 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:21:29.674784    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11\": container with ID starting with 152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11 not found: ID does not exist" containerID="152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11"
Jul 17 11:21:29.674939 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.674818    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11"} err="failed to get container status \"152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11\": rpc error: code = NotFound desc = could not find container \"152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11\": container with ID starting with 152477639fd7e8f16bb835e6bdc1265c85bd2a7880f411fe7cc2f00889e92f11 not found: ID does not exist"
Jul 17 11:21:29.674939 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.674837    2562 scope.go:117] "RemoveContainer" containerID="973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d"
Jul 17 11:21:29.675304 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:21:29.675264    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d\": container with ID starting with 973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d not found: ID does not exist" containerID="973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d"
Jul 17 11:21:29.675410 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.675314    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d"} err="failed to get container status \"973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d\": rpc error: code = NotFound desc = could not find container \"973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d\": container with ID starting with 973a16105cee77615a528794fae521aafd1fabf2cf5c9146b60d595d61295a1d not found: ID does not exist"
Jul 17 11:21:29.682950 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.682930    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"]
Jul 17 11:21:29.683063 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:29.682961    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0839e276-openshift-default-58fc74866c-8hwnn"]
Jul 17 11:21:30.138122 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:30.138090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:30.530735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:30.530654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:31.680520 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:31.680487    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" path="/var/lib/kubelet/pods/8881f480-ebd5-49c8-80e1-fa8a0d1a130e/volumes"
Jul 17 11:21:35.663723 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:35.663688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:36.181357 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.181321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:36.285705 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.285668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:36.501750 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.501670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:36.600698 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.600668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:36.666000 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.665961    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"]
Jul 17 11:21:36.666391 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666352    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:21:36.666391 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666375    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:21:36.666391 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666387    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:21:36.666391 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666393    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666405    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666411    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666425    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666431    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666489    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d54a528d-b9b8-4139-bc45-4f6210c5728b" containerName="revoke-keys"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666496    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666502    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666507    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:21:36.666576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.666512    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:21:36.670974 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.670949    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.673889 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.673868    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4d5573f1-gw-openshift-default-dockercfg-5nn85\""
Jul 17 11:21:36.683938 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.683912    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"]
Jul 17 11:21:36.710626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.710589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:36.748171 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-istio-token\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.748323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-data\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.748323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31bdd83-e819-4201-98bd-91b983f1984f-istiod-ca-cert\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.748323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-socket\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.748323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31bdd83-e819-4201-98bd-91b983f1984f-istio-podinfo\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.748323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-certs\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.748569 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-credential-socket\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.748569 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-envoy\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.748569 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.748467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgz5f\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-kube-api-access-fgz5f\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.812515 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.812409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:36.849140 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849107    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-istio-token\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-data\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849167    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31bdd83-e819-4201-98bd-91b983f1984f-istiod-ca-cert\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-socket\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31bdd83-e819-4201-98bd-91b983f1984f-istio-podinfo\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849289    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-certs\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849557 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-credential-socket\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849557 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-envoy\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849557 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgz5f\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-kube-api-access-fgz5f\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849783 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-data\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849783 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-socket\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849783 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849763    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-credential-socket\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.849903 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.849835    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-certs\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.850053 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.850031    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31bdd83-e819-4201-98bd-91b983f1984f-istiod-ca-cert\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.851612 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.851592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-envoy\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.851827 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.851809    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31bdd83-e819-4201-98bd-91b983f1984f-istio-podinfo\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.858614 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.858591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-istio-token\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.858722 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.858661    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgz5f\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-kube-api-access-fgz5f\") pod \"e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") " pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:36.982961 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:36.982921    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:37.127607 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:37.127557    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"]
Jul 17 11:21:37.129812 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:21:37.129784    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31bdd83_e819_4201_98bd_91b983f1984f.slice/crio-538df155096198176c1b7f5784ef9a8d57bb7a615c022165149c6ef5721d9290 WatchSource:0}: Error finding container 538df155096198176c1b7f5784ef9a8d57bb7a615c022165149c6ef5721d9290: Status 404 returned error can't find the container with id 538df155096198176c1b7f5784ef9a8d57bb7a615c022165149c6ef5721d9290
Jul 17 11:21:37.131816 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:37.131779    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:21:37.131906 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:37.131850    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:21:37.131906 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:37.131884    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:21:37.692069 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:37.692032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" event={"ID":"e31bdd83-e819-4201-98bd-91b983f1984f","Type":"ContainerStarted","Data":"44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407"}
Jul 17 11:21:37.692464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:37.692108    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" event={"ID":"e31bdd83-e819-4201-98bd-91b983f1984f","Type":"ContainerStarted","Data":"538df155096198176c1b7f5784ef9a8d57bb7a615c022165149c6ef5721d9290"}
Jul 17 11:21:37.718816 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:37.718766    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" podStartSLOduration=1.7187489500000002 podStartE2EDuration="1.71874895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:21:37.717742362 +0000 UTC m=+1738.522767869" watchObservedRunningTime="2026-07-17 11:21:37.71874895 +0000 UTC m=+1738.523774435"
Jul 17 11:21:37.983655 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:37.983555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:38.101680 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:38.101646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:38.296260 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:38.296184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:38.792666 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:38.792622    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:38.894317 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:38.894278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:38.988005 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:38.987977    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:39.707720 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:39.707683    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:39.708605 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:39.708583    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:40.257638 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:40.257607    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:21:53.782678 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:53.782647    2562 generic.go:356] "Generic (PLEG): container finished" podID="e31bdd83-e819-4201-98bd-91b983f1984f" containerID="44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407" exitCode=0
Jul 17 11:21:53.783050 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:53.782720    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" event={"ID":"e31bdd83-e819-4201-98bd-91b983f1984f","Type":"ContainerDied","Data":"44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407"}
Jul 17 11:21:53.783137 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:53.783123    2562 scope.go:117] "RemoveContainer" containerID="44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407"
Jul 17 11:21:53.784167 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:53.784118    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:21:53.784270 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:53.784219    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:21:53.784270 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:53.784262    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:21:54.707794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:54.707751    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:54.789563 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:54.789528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" event={"ID":"e31bdd83-e819-4201-98bd-91b983f1984f","Type":"ContainerStarted","Data":"843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8"}
Jul 17 11:21:54.983950 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:54.983861    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:54.985126 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:54.985103    2562 patch_prober.go:28] interesting pod/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 17 11:21:54.985181 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:54.985153    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 17 11:21:55.983687 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:55.983644    2562 patch_prober.go:28] interesting pod/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 17 11:21:55.984210 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:55.983713    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 17 11:21:56.983662 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:56.983616    2562 patch_prober.go:28] interesting pod/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 17 11:21:56.983879 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:56.983692    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 17 11:21:57.983893 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:57.983850    2562 patch_prober.go:28] interesting pod/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 17 11:21:57.984445 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:57.983923    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 17 11:21:58.988091 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:58.988043    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:58.988535 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:58.988324    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:21:58.988995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:21:58.988979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:22:01.630908 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:01.630873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:01.731439 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:01.731396    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:13.074109 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:13.074055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:13.175357 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:13.175326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:42.488290 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.488257    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"]
Jul 17 11:22:42.488723 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.488666    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:22:42.488723 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.488679    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc377e35-26a0-4eff-baa0-4865e3a4d7e0" containerName="revoke-keys"
Jul 17 11:22:42.488800 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.488732    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8881f480-ebd5-49c8-80e1-fa8a0d1a130e" containerName="istio-proxy"
Jul 17 11:22:42.491880 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.491863    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"
Jul 17 11:22:42.494825 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.494801    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:22:42.494967 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.494858    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:22:42.500291 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.500267    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"]
Jul 17 11:22:42.553725 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.553683    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae417236-5ad7-41a5-876f-4693439ff04c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d\" (UID: \"ae417236-5ad7-41a5-876f-4693439ff04c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"
Jul 17 11:22:42.655266 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.655230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae417236-5ad7-41a5-876f-4693439ff04c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d\" (UID: \"ae417236-5ad7-41a5-876f-4693439ff04c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"
Jul 17 11:22:42.655857 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.655838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae417236-5ad7-41a5-876f-4693439ff04c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d\" (UID: \"ae417236-5ad7-41a5-876f-4693439ff04c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"
Jul 17 11:22:42.804412 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.804321    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"
Jul 17 11:22:42.944017 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:42.943987    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"]
Jul 17 11:22:42.945542 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:22:42.945517    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae417236_5ad7_41a5_876f_4693439ff04c.slice/crio-bfaf48128bef3148e86b8ff4a0cde5d08bf54ee9a22ebb0c4ec41dedf5a9bada WatchSource:0}: Error finding container bfaf48128bef3148e86b8ff4a0cde5d08bf54ee9a22ebb0c4ec41dedf5a9bada: Status 404 returned error can't find the container with id bfaf48128bef3148e86b8ff4a0cde5d08bf54ee9a22ebb0c4ec41dedf5a9bada
Jul 17 11:22:43.018152 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:43.018113    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" event={"ID":"ae417236-5ad7-41a5-876f-4693439ff04c","Type":"ContainerStarted","Data":"bfaf48128bef3148e86b8ff4a0cde5d08bf54ee9a22ebb0c4ec41dedf5a9bada"}
Jul 17 11:22:43.486202 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:43.486100    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"]
Jul 17 11:22:43.486411 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:43.486350    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy" containerID="cri-o://843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8" gracePeriod=30
Jul 17 11:22:43.513004 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:43.512946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:43.616306 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:43.616273    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:43.990765 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:43.990730    2562 patch_prober.go:28] interesting pod/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 11:22:43.990928 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:43.990791    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 11:22:44.030836 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:44.030796    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae417236-5ad7-41a5-876f-4693439ff04c" containerID="90e7f8e27760a6cb319a3de7d280098d8525cb11be58a1768c6b264a157d5058" exitCode=7
Jul 17 11:22:44.031004 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:44.030868    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" event={"ID":"ae417236-5ad7-41a5-876f-4693439ff04c","Type":"ContainerDied","Data":"90e7f8e27760a6cb319a3de7d280098d8525cb11be58a1768c6b264a157d5058"}
Jul 17 11:22:44.031046 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:44.031013    2562 scope.go:117] "RemoveContainer" containerID="90e7f8e27760a6cb319a3de7d280098d8525cb11be58a1768c6b264a157d5058"
Jul 17 11:22:45.037502 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:45.037414    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae417236-5ad7-41a5-876f-4693439ff04c" containerID="581320017e5cb19a1265f7518789b0407f45cb9833ee90824caee808f9c2529f" exitCode=7
Jul 17 11:22:45.037502 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:45.037455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" event={"ID":"ae417236-5ad7-41a5-876f-4693439ff04c","Type":"ContainerDied","Data":"581320017e5cb19a1265f7518789b0407f45cb9833ee90824caee808f9c2529f"}
Jul 17 11:22:45.037502 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:45.037503    2562 scope.go:117] "RemoveContainer" containerID="90e7f8e27760a6cb319a3de7d280098d8525cb11be58a1768c6b264a157d5058"
Jul 17 11:22:45.037966 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:45.037688    2562 scope.go:117] "RemoveContainer" containerID="581320017e5cb19a1265f7518789b0407f45cb9833ee90824caee808f9c2529f"
Jul 17 11:22:45.037966 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:22:45.037941    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d_odh-ai-gateway-infra(ae417236-5ad7-41a5-876f-4693439ff04c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" podUID="ae417236-5ad7-41a5-876f-4693439ff04c"
Jul 17 11:22:46.043714 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:46.043685    2562 scope.go:117] "RemoveContainer" containerID="581320017e5cb19a1265f7518789b0407f45cb9833ee90824caee808f9c2529f"
Jul 17 11:22:46.044125 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:22:46.043892    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d_odh-ai-gateway-infra(ae417236-5ad7-41a5-876f-4693439ff04c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" podUID="ae417236-5ad7-41a5-876f-4693439ff04c"
Jul 17 11:22:48.748134 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.748106    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:22:48.814870 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.814829    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-socket\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815053 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.814897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-certs\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815053 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.814945    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31bdd83-e819-4201-98bd-91b983f1984f-istio-podinfo\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815053 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815036    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-data\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815069    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31bdd83-e819-4201-98bd-91b983f1984f-istiod-ca-cert\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815127    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgz5f\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-kube-api-access-fgz5f\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815161    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-istio-token\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815182    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-envoy\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815182    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:22:48.815272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815228    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-credential-socket\") pod \"e31bdd83-e819-4201-98bd-91b983f1984f\" (UID: \"e31bdd83-e819-4201-98bd-91b983f1984f\") "
Jul 17 11:22:48.815272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815233    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:22:48.815635 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815558    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:48.815635 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.815573    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-workload-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:48.816289 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.816023    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e31bdd83-e819-4201-98bd-91b983f1984f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:22:48.816414 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.816315    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:22:48.816936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.816875    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:22:48.817926 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.817901    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-kube-api-access-fgz5f" (OuterVolumeSpecName: "kube-api-access-fgz5f") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "kube-api-access-fgz5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:22:48.818036 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.817931    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e31bdd83-e819-4201-98bd-91b983f1984f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 11:22:48.818036 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.818017    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:22:48.818230 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.818208    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e31bdd83-e819-4201-98bd-91b983f1984f" (UID: "e31bdd83-e819-4201-98bd-91b983f1984f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:22:48.916606 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.916573    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e31bdd83-e819-4201-98bd-91b983f1984f-istio-podinfo\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:48.916606 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.916603    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-data\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:48.916606 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.916614    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e31bdd83-e819-4201-98bd-91b983f1984f-istiod-ca-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:48.916846 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.916622    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgz5f\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-kube-api-access-fgz5f\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:48.916846 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.916631    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e31bdd83-e819-4201-98bd-91b983f1984f-istio-token\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:48.916846 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.916643    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-istio-envoy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:48.916846 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:48.916650    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e31bdd83-e819-4201-98bd-91b983f1984f-credential-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:22:49.021974 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.021936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:49.059172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.059058    2562 generic.go:356] "Generic (PLEG): container finished" podID="e31bdd83-e819-4201-98bd-91b983f1984f" containerID="843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8" exitCode=0
Jul 17 11:22:49.059172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.059127    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"
Jul 17 11:22:49.059172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.059144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" event={"ID":"e31bdd83-e819-4201-98bd-91b983f1984f","Type":"ContainerDied","Data":"843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8"}
Jul 17 11:22:49.059451 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.059211    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs" event={"ID":"e31bdd83-e819-4201-98bd-91b983f1984f","Type":"ContainerDied","Data":"538df155096198176c1b7f5784ef9a8d57bb7a615c022165149c6ef5721d9290"}
Jul 17 11:22:49.059451 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.059244    2562 scope.go:117] "RemoveContainer" containerID="843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8"
Jul 17 11:22:49.075255 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.075233    2562 scope.go:117] "RemoveContainer" containerID="44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407"
Jul 17 11:22:49.083168 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.083139    2562 scope.go:117] "RemoveContainer" containerID="843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8"
Jul 17 11:22:49.083426 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:22:49.083404    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8\": container with ID starting with 843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8 not found: ID does not exist" containerID="843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8"
Jul 17 11:22:49.083486 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.083434    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8"} err="failed to get container status \"843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8\": rpc error: code = NotFound desc = could not find container \"843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8\": container with ID starting with 843478d355ea3708cedeab94398c866edc6e8f263414540fdf5ea7bb09b2a0f8 not found: ID does not exist"
Jul 17 11:22:49.083486 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.083454    2562 scope.go:117] "RemoveContainer" containerID="44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407"
Jul 17 11:22:49.083720 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:22:49.083704    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407\": container with ID starting with 44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407 not found: ID does not exist" containerID="44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407"
Jul 17 11:22:49.083764 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.083732    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407"} err="failed to get container status \"44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407\": rpc error: code = NotFound desc = could not find container \"44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407\": container with ID starting with 44a40fbe081ad74110312a21d3b6bc5bbd7658747417bef8bdf9f194a2278407 not found: ID does not exist"
Jul 17 11:22:49.090231 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.090207    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"]
Jul 17 11:22:49.098466 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.098443    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4d5573f1-gw-openshift-default-685844f7ff-lmgfs"]
Jul 17 11:22:49.621599 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.621571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:49.681443 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.681412    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" path="/var/lib/kubelet/pods/e31bdd83-e819-4201-98bd-91b983f1984f/volumes"
Jul 17 11:22:49.906817 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:49.906786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:55.694295 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.694256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:55.796406 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.796372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:55.930518 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.930490    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"]
Jul 17 11:22:55.931108 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.931071    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy"
Jul 17 11:22:55.931165 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.931114    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy"
Jul 17 11:22:55.931165 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.931129    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy"
Jul 17 11:22:55.931165 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.931137    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy"
Jul 17 11:22:55.931278 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.931266    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy"
Jul 17 11:22:55.936457 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.936435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:55.939758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.939737    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eac6ba90-openshift-default-dockercfg-2f47q\""
Jul 17 11:22:55.954656 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.954597    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"]
Jul 17 11:22:55.964910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:55.964886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:56.061283 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.061252    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:56.089167 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-token\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.089290 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-credential-socket\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.089290 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nmhk\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-kube-api-access-4nmhk\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.089290 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99649e92-6b8c-4e76-a6be-039d38979cd9-istiod-ca-cert\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.089391 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-certs\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.089391 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-socket\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.089391 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-envoy\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.089483 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-podinfo\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.089483 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.089438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-data\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190044 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-podinfo\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190254 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-data\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190254 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-token\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190254 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190137    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-credential-socket\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190254 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190153    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nmhk\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-kube-api-access-4nmhk\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190254 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99649e92-6b8c-4e76-a6be-039d38979cd9-istiod-ca-cert\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190254 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-certs\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190561 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-socket\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190561 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-envoy\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190679 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-credential-socket\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190726 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190675    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-certs\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190726 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-socket\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190857 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190833    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-data\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.190975 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.190950    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99649e92-6b8c-4e76-a6be-039d38979cd9-istiod-ca-cert\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.192541 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.192510    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-envoy\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.192693 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.192678    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-podinfo\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.199578 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.199560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-token\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.199757 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.199741    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nmhk\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-kube-api-access-4nmhk\") pod \"e2e-ait-eac6ba90-openshift-default-846856b869-4xcct\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") " pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.246835 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.246751    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:56.396164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.396139    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"]
Jul 17 11:22:56.397535 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:22:56.397497    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99649e92_6b8c_4e76_a6be_039d38979cd9.slice/crio-69ab6da447f84df1597a485c248da7cb636c97e78b6ea91d02aacf9043db8473 WatchSource:0}: Error finding container 69ab6da447f84df1597a485c248da7cb636c97e78b6ea91d02aacf9043db8473: Status 404 returned error can't find the container with id 69ab6da447f84df1597a485c248da7cb636c97e78b6ea91d02aacf9043db8473
Jul 17 11:22:56.399602 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.399569    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:22:56.399663 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.399639    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:22:56.399707 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:56.399670    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:22:57.102204 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.102171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" event={"ID":"99649e92-6b8c-4e76-a6be-039d38979cd9","Type":"ContainerStarted","Data":"8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea"}
Jul 17 11:22:57.102606 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.102226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" event={"ID":"99649e92-6b8c-4e76-a6be-039d38979cd9","Type":"ContainerStarted","Data":"69ab6da447f84df1597a485c248da7cb636c97e78b6ea91d02aacf9043db8473"}
Jul 17 11:22:57.139626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.139572    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podStartSLOduration=2.139552811 podStartE2EDuration="2.139552811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:22:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:22:57.138070782 +0000 UTC m=+1817.943096267" watchObservedRunningTime="2026-07-17 11:22:57.139552811 +0000 UTC m=+1817.944578296"
Jul 17 11:22:57.151877 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.151845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:57.246423 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.246393    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:57.247227 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.247210    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:57.252488 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.252460    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:57.324158 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.324110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:57.516880 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.516848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:57.675044 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.675016    2562 scope.go:117] "RemoveContainer" containerID="581320017e5cb19a1265f7518789b0407f45cb9833ee90824caee808f9c2529f"
Jul 17 11:22:57.969355 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:57.969327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:58.072466 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:58.072432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:22:58.108911 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:58.108879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" event={"ID":"ae417236-5ad7-41a5-876f-4693439ff04c","Type":"ContainerStarted","Data":"3ca2ab46c7c1ca658ed5b3b2d45ad58b298c1ed5cb4bbc21ef8c9abbda66a62b"}
Jul 17 11:22:58.109406 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:58.109279    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:58.110209 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:58.110190    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:22:58.135176 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:58.135124    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" podStartSLOduration=16.135108703 podStartE2EDuration="16.135108703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:22:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:22:58.132760531 +0000 UTC m=+1818.937786017" watchObservedRunningTime="2026-07-17 11:22:58.135108703 +0000 UTC m=+1818.940134189"
Jul 17 11:22:59.115594 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:59.115557    2562 generic.go:356] "Generic (PLEG): container finished" podID="ae417236-5ad7-41a5-876f-4693439ff04c" containerID="3ca2ab46c7c1ca658ed5b3b2d45ad58b298c1ed5cb4bbc21ef8c9abbda66a62b" exitCode=6
Jul 17 11:22:59.115993 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:59.115634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" event={"ID":"ae417236-5ad7-41a5-876f-4693439ff04c","Type":"ContainerDied","Data":"3ca2ab46c7c1ca658ed5b3b2d45ad58b298c1ed5cb4bbc21ef8c9abbda66a62b"}
Jul 17 11:22:59.115993 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:59.115732    2562 scope.go:117] "RemoveContainer" containerID="581320017e5cb19a1265f7518789b0407f45cb9833ee90824caee808f9c2529f"
Jul 17 11:22:59.116110 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:59.116058    2562 scope.go:117] "RemoveContainer" containerID="3ca2ab46c7c1ca658ed5b3b2d45ad58b298c1ed5cb4bbc21ef8c9abbda66a62b"
Jul 17 11:22:59.116318 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:22:59.116295    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d_odh-ai-gateway-infra(ae417236-5ad7-41a5-876f-4693439ff04c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" podUID="ae417236-5ad7-41a5-876f-4693439ff04c"
Jul 17 11:22:59.144322 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:59.144291    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"]
Jul 17 11:22:59.207421 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:22:59.207384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:23:00.261002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:00.260976    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"
Jul 17 11:23:00.434889 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:00.434788    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae417236-5ad7-41a5-876f-4693439ff04c-maas-api-service-ca\") pod \"ae417236-5ad7-41a5-876f-4693439ff04c\" (UID: \"ae417236-5ad7-41a5-876f-4693439ff04c\") "
Jul 17 11:23:00.435190 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:00.435167    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae417236-5ad7-41a5-876f-4693439ff04c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae417236-5ad7-41a5-876f-4693439ff04c" (UID: "ae417236-5ad7-41a5-876f-4693439ff04c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:23:00.536023 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:00.535988    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae417236-5ad7-41a5-876f-4693439ff04c-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:23:01.127304 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:01.127263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d" event={"ID":"ae417236-5ad7-41a5-876f-4693439ff04c","Type":"ContainerDied","Data":"bfaf48128bef3148e86b8ff4a0cde5d08bf54ee9a22ebb0c4ec41dedf5a9bada"}
Jul 17 11:23:01.127304 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:01.127298    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"
Jul 17 11:23:01.127551 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:01.127341    2562 scope.go:117] "RemoveContainer" containerID="3ca2ab46c7c1ca658ed5b3b2d45ad58b298c1ed5cb4bbc21ef8c9abbda66a62b"
Jul 17 11:23:01.154045 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:01.154016    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"]
Jul 17 11:23:01.162443 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:01.162417    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-4d5573f1-blc8d"]
Jul 17 11:23:01.680484 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:01.680448    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" path="/var/lib/kubelet/pods/ae417236-5ad7-41a5-876f-4693439ff04c/volumes"
Jul 17 11:23:02.151346 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151311    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"]
Jul 17 11:23:02.151692 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151678    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:23:02.151692 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151691    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:23:02.151808 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151743    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:23:02.151808 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151755    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:23:02.151884 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151866    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e31bdd83-e819-4201-98bd-91b983f1984f" containerName="istio-proxy"
Jul 17 11:23:02.151884 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151879    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:23:02.151954 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151892    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:23:02.151954 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.151901    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:23:02.156339 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.156322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"
Jul 17 11:23:02.158926 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.158901    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:23:02.158926 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.158923    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:23:02.162484 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.162460    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"]
Jul 17 11:23:02.252561 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.252524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65357250-4add-4f1d-86fb-bd023e89c484-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq\" (UID: \"65357250-4add-4f1d-86fb-bd023e89c484\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"
Jul 17 11:23:02.354160 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.354126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65357250-4add-4f1d-86fb-bd023e89c484-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq\" (UID: \"65357250-4add-4f1d-86fb-bd023e89c484\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"
Jul 17 11:23:02.354766 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.354746    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65357250-4add-4f1d-86fb-bd023e89c484-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq\" (UID: \"65357250-4add-4f1d-86fb-bd023e89c484\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"
Jul 17 11:23:02.468704 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.468619    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"
Jul 17 11:23:02.603986 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:02.603955    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"]
Jul 17 11:23:02.606294 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:23:02.606263    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65357250_4add_4f1d_86fb_bd023e89c484.slice/crio-cd39d1c0da525a9149bb0c5204abd9ba96e6a0848486c0491bc0fa7d49f8fc06 WatchSource:0}: Error finding container cd39d1c0da525a9149bb0c5204abd9ba96e6a0848486c0491bc0fa7d49f8fc06: Status 404 returned error can't find the container with id cd39d1c0da525a9149bb0c5204abd9ba96e6a0848486c0491bc0fa7d49f8fc06
Jul 17 11:23:03.139092 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:03.139049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" event={"ID":"65357250-4add-4f1d-86fb-bd023e89c484","Type":"ContainerStarted","Data":"b66ecec9a196c524796752985e082f62ebc1e606a0fe357c14ba03d1fa5772bc"}
Jul 17 11:23:03.139472 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:03.139119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" event={"ID":"65357250-4add-4f1d-86fb-bd023e89c484","Type":"ContainerStarted","Data":"cd39d1c0da525a9149bb0c5204abd9ba96e6a0848486c0491bc0fa7d49f8fc06"}
Jul 17 11:23:03.154862 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:03.154806    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" podStartSLOduration=1.154792629 podStartE2EDuration="1.154792629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:23:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:23:03.153728619 +0000 UTC m=+1823.958754104" watchObservedRunningTime="2026-07-17 11:23:03.154792629 +0000 UTC m=+1823.959818115"
Jul 17 11:23:04.145050 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:04.145010    2562 generic.go:356] "Generic (PLEG): container finished" podID="65357250-4add-4f1d-86fb-bd023e89c484" containerID="b66ecec9a196c524796752985e082f62ebc1e606a0fe357c14ba03d1fa5772bc" exitCode=7
Jul 17 11:23:04.145539 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:04.145104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" event={"ID":"65357250-4add-4f1d-86fb-bd023e89c484","Type":"ContainerDied","Data":"b66ecec9a196c524796752985e082f62ebc1e606a0fe357c14ba03d1fa5772bc"}
Jul 17 11:23:04.145539 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:04.145344    2562 scope.go:117] "RemoveContainer" containerID="b66ecec9a196c524796752985e082f62ebc1e606a0fe357c14ba03d1fa5772bc"
Jul 17 11:23:05.152240 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:05.152201    2562 generic.go:356] "Generic (PLEG): container finished" podID="65357250-4add-4f1d-86fb-bd023e89c484" containerID="ed615ff3de2f58839763bd448dcbbf02ddb42a7ae12935aaba40521bed5e08d9" exitCode=7
Jul 17 11:23:05.152680 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:05.152282    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" event={"ID":"65357250-4add-4f1d-86fb-bd023e89c484","Type":"ContainerDied","Data":"ed615ff3de2f58839763bd448dcbbf02ddb42a7ae12935aaba40521bed5e08d9"}
Jul 17 11:23:05.152680 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:05.152342    2562 scope.go:117] "RemoveContainer" containerID="b66ecec9a196c524796752985e082f62ebc1e606a0fe357c14ba03d1fa5772bc"
Jul 17 11:23:05.152680 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:05.152592    2562 scope.go:117] "RemoveContainer" containerID="ed615ff3de2f58839763bd448dcbbf02ddb42a7ae12935aaba40521bed5e08d9"
Jul 17 11:23:05.152853 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:23:05.152834    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq_odh-ai-gateway-infra(65357250-4add-4f1d-86fb-bd023e89c484)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" podUID="65357250-4add-4f1d-86fb-bd023e89c484"
Jul 17 11:23:06.158606 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:06.158573    2562 scope.go:117] "RemoveContainer" containerID="ed615ff3de2f58839763bd448dcbbf02ddb42a7ae12935aaba40521bed5e08d9"
Jul 17 11:23:06.159106 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:23:06.158848    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq_odh-ai-gateway-infra(65357250-4add-4f1d-86fb-bd023e89c484)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" podUID="65357250-4add-4f1d-86fb-bd023e89c484"
Jul 17 11:23:13.110524 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:13.110486    2562 patch_prober.go:28] interesting pod/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 17 11:23:13.110977 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:13.110543    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 17 11:23:13.195147 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:13.195108    2562 generic.go:356] "Generic (PLEG): container finished" podID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerID="8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea" exitCode=0
Jul 17 11:23:13.195316 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:13.195179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" event={"ID":"99649e92-6b8c-4e76-a6be-039d38979cd9","Type":"ContainerDied","Data":"8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea"}
Jul 17 11:23:13.195592 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:13.195579    2562 scope.go:117] "RemoveContainer" containerID="8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea"
Jul 17 11:23:13.196580 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:13.196553    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:23:13.196686 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:13.196622    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:23:13.196686 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:13.196661    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:23:14.201936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:14.201899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" event={"ID":"99649e92-6b8c-4e76-a6be-039d38979cd9","Type":"ContainerStarted","Data":"4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348"}
Jul 17 11:23:14.247824 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:14.247777    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:23:14.248060 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:14.248036    2562 patch_prober.go:28] interesting pod/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 17 11:23:14.248173 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:14.248116    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 17 11:23:15.247286 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:15.247249    2562 patch_prober.go:28] interesting pod/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 17 11:23:15.247698 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:15.247307    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 17 11:23:16.248043 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:16.248000    2562 patch_prober.go:28] interesting pod/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 17 11:23:16.248468 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:16.248065    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 17 11:23:17.247636 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:17.247597    2562 patch_prober.go:28] interesting pod/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 17 11:23:17.247830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:17.247662    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 17 11:23:17.674758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:17.674729    2562 scope.go:117] "RemoveContainer" containerID="ed615ff3de2f58839763bd448dcbbf02ddb42a7ae12935aaba40521bed5e08d9"
Jul 17 11:23:18.227785 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:18.227737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" event={"ID":"65357250-4add-4f1d-86fb-bd023e89c484","Type":"ContainerStarted","Data":"a43a9042cd148a8dac1cc1ba0e862f6243781d5a84fdbe253fd576744dd2cd3c"}
Jul 17 11:23:18.247175 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:18.247135    2562 patch_prober.go:28] interesting pod/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 17 11:23:18.247358 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:18.247207    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 17 11:23:19.234773 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:19.234737    2562 generic.go:356] "Generic (PLEG): container finished" podID="65357250-4add-4f1d-86fb-bd023e89c484" containerID="a43a9042cd148a8dac1cc1ba0e862f6243781d5a84fdbe253fd576744dd2cd3c" exitCode=7
Jul 17 11:23:19.235246 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:19.234811    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" event={"ID":"65357250-4add-4f1d-86fb-bd023e89c484","Type":"ContainerDied","Data":"a43a9042cd148a8dac1cc1ba0e862f6243781d5a84fdbe253fd576744dd2cd3c"}
Jul 17 11:23:19.235246 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:19.234878    2562 scope.go:117] "RemoveContainer" containerID="ed615ff3de2f58839763bd448dcbbf02ddb42a7ae12935aaba40521bed5e08d9"
Jul 17 11:23:19.235246 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:19.235130    2562 scope.go:117] "RemoveContainer" containerID="a43a9042cd148a8dac1cc1ba0e862f6243781d5a84fdbe253fd576744dd2cd3c"
Jul 17 11:23:19.235379 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:23:19.235352    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq_odh-ai-gateway-infra(65357250-4add-4f1d-86fb-bd023e89c484)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" podUID="65357250-4add-4f1d-86fb-bd023e89c484"
Jul 17 11:23:19.252288 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:19.252259    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:23:19.252599 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:19.252580    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:23:19.253326 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:19.253310    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:23:19.261138 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:19.261110    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"]
Jul 17 11:23:20.372035 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:20.372008    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"
Jul 17 11:23:20.399659 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:20.399626    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65357250-4add-4f1d-86fb-bd023e89c484-maas-api-service-ca\") pod \"65357250-4add-4f1d-86fb-bd023e89c484\" (UID: \"65357250-4add-4f1d-86fb-bd023e89c484\") "
Jul 17 11:23:20.399947 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:20.399927    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65357250-4add-4f1d-86fb-bd023e89c484-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "65357250-4add-4f1d-86fb-bd023e89c484" (UID: "65357250-4add-4f1d-86fb-bd023e89c484"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:23:20.500562 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:20.500472    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65357250-4add-4f1d-86fb-bd023e89c484-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:23:21.247455 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:21.247413    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq" event={"ID":"65357250-4add-4f1d-86fb-bd023e89c484","Type":"ContainerDied","Data":"cd39d1c0da525a9149bb0c5204abd9ba96e6a0848486c0491bc0fa7d49f8fc06"}
Jul 17 11:23:21.247649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:21.247493    2562 scope.go:117] "RemoveContainer" containerID="a43a9042cd148a8dac1cc1ba0e862f6243781d5a84fdbe253fd576744dd2cd3c"
Jul 17 11:23:21.247649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:21.247429    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"
Jul 17 11:23:21.268995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:21.268967    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"]
Jul 17 11:23:21.277229 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:21.277198    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-4qkkq"]
Jul 17 11:23:21.680880 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:21.680831    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65357250-4add-4f1d-86fb-bd023e89c484" path="/var/lib/kubelet/pods/65357250-4add-4f1d-86fb-bd023e89c484/volumes"
Jul 17 11:23:40.637918 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:23:40.637857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:24:42.277316 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277280    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"]
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277635    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277647    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277659    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277665    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae417236-5ad7-41a5-876f-4693439ff04c" containerName="revoke-keys"
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277687    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277693    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277750    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277758    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:24:42.277793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.277765    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:24:42.280749 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.280732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"
Jul 17 11:24:42.283321 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.283302    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:24:42.283591 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.283575    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:24:42.288999 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.288686    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"]
Jul 17 11:24:42.455701 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.455666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a83391-6937-45b0-9f86-8b6ce6b07ed7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t\" (UID: \"f9a83391-6937-45b0-9f86-8b6ce6b07ed7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"
Jul 17 11:24:42.557271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.557181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a83391-6937-45b0-9f86-8b6ce6b07ed7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t\" (UID: \"f9a83391-6937-45b0-9f86-8b6ce6b07ed7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"
Jul 17 11:24:42.557811 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.557791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a83391-6937-45b0-9f86-8b6ce6b07ed7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t\" (UID: \"f9a83391-6937-45b0-9f86-8b6ce6b07ed7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"
Jul 17 11:24:42.594409 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.594347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"
Jul 17 11:24:42.729903 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:42.729873    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"]
Jul 17 11:24:42.732032 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:24:42.732005    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a83391_6937_45b0_9f86_8b6ce6b07ed7.slice/crio-1844ac408f831fe7e5bacd004279abea911a4212d7e774dbe86e529a4a0f824b WatchSource:0}: Error finding container 1844ac408f831fe7e5bacd004279abea911a4212d7e774dbe86e529a4a0f824b: Status 404 returned error can't find the container with id 1844ac408f831fe7e5bacd004279abea911a4212d7e774dbe86e529a4a0f824b
Jul 17 11:24:43.642932 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:43.642894    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerID="9394174d5f919abbe5c1d4fb3adc513ec199abc3aca85bcabf70d5b22edfa0ac" exitCode=7
Jul 17 11:24:43.643323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:43.642975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t" event={"ID":"f9a83391-6937-45b0-9f86-8b6ce6b07ed7","Type":"ContainerDied","Data":"9394174d5f919abbe5c1d4fb3adc513ec199abc3aca85bcabf70d5b22edfa0ac"}
Jul 17 11:24:43.643323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:43.643051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t" event={"ID":"f9a83391-6937-45b0-9f86-8b6ce6b07ed7","Type":"ContainerStarted","Data":"1844ac408f831fe7e5bacd004279abea911a4212d7e774dbe86e529a4a0f824b"}
Jul 17 11:24:43.643323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:43.643174    2562 scope.go:117] "RemoveContainer" containerID="9394174d5f919abbe5c1d4fb3adc513ec199abc3aca85bcabf70d5b22edfa0ac"
Jul 17 11:24:44.650246 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:44.650212    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerID="45acc5c0d29e19f5e1cfaecbae7b44e03fbd38be5bb5f80b5522fbd7b9caed32" exitCode=7
Jul 17 11:24:44.650727 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:44.650296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t" event={"ID":"f9a83391-6937-45b0-9f86-8b6ce6b07ed7","Type":"ContainerDied","Data":"45acc5c0d29e19f5e1cfaecbae7b44e03fbd38be5bb5f80b5522fbd7b9caed32"}
Jul 17 11:24:44.650727 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:44.650352    2562 scope.go:117] "RemoveContainer" containerID="9394174d5f919abbe5c1d4fb3adc513ec199abc3aca85bcabf70d5b22edfa0ac"
Jul 17 11:24:44.650727 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:44.650576    2562 scope.go:117] "RemoveContainer" containerID="45acc5c0d29e19f5e1cfaecbae7b44e03fbd38be5bb5f80b5522fbd7b9caed32"
Jul 17 11:24:44.650909 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:24:44.650831    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t_odh-ai-gateway-infra(f9a83391-6937-45b0-9f86-8b6ce6b07ed7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7"
Jul 17 11:24:45.656766 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:24:45.656743    2562 scope.go:117] "RemoveContainer" containerID="45acc5c0d29e19f5e1cfaecbae7b44e03fbd38be5bb5f80b5522fbd7b9caed32"
Jul 17 11:24:45.657140 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:24:45.656942    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t_odh-ai-gateway-infra(f9a83391-6937-45b0-9f86-8b6ce6b07ed7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7"
Jul 17 11:25:00.675262 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:00.675234    2562 scope.go:117] "RemoveContainer" containerID="45acc5c0d29e19f5e1cfaecbae7b44e03fbd38be5bb5f80b5522fbd7b9caed32"
Jul 17 11:25:01.731471 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:01.731436    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerID="28d082803a79a95af9310f220540c503bbc307603a02ffde7026f7fbbbb4bd27" exitCode=7
Jul 17 11:25:01.731883 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:01.731505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t" event={"ID":"f9a83391-6937-45b0-9f86-8b6ce6b07ed7","Type":"ContainerDied","Data":"28d082803a79a95af9310f220540c503bbc307603a02ffde7026f7fbbbb4bd27"}
Jul 17 11:25:01.731883 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:01.731562    2562 scope.go:117] "RemoveContainer" containerID="45acc5c0d29e19f5e1cfaecbae7b44e03fbd38be5bb5f80b5522fbd7b9caed32"
Jul 17 11:25:01.731883 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:01.731873    2562 scope.go:117] "RemoveContainer" containerID="28d082803a79a95af9310f220540c503bbc307603a02ffde7026f7fbbbb4bd27"
Jul 17 11:25:01.732136 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:25:01.732108    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t_odh-ai-gateway-infra(f9a83391-6937-45b0-9f86-8b6ce6b07ed7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7"
Jul 17 11:25:02.181728 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:02.181686    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:25:02.758188 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:02.758161    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"]
Jul 17 11:25:02.899892 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:02.899868    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"
Jul 17 11:25:02.951430 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:02.951402    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a83391-6937-45b0-9f86-8b6ce6b07ed7-maas-api-service-ca\") pod \"f9a83391-6937-45b0-9f86-8b6ce6b07ed7\" (UID: \"f9a83391-6937-45b0-9f86-8b6ce6b07ed7\") "
Jul 17 11:25:02.951758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:02.951737    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9a83391-6937-45b0-9f86-8b6ce6b07ed7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9a83391-6937-45b0-9f86-8b6ce6b07ed7" (UID: "f9a83391-6937-45b0-9f86-8b6ce6b07ed7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:25:03.052692 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:03.052619    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9a83391-6937-45b0-9f86-8b6ce6b07ed7-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:25:03.744355 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:03.744328    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"
Jul 17 11:25:03.744507 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:03.744354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t" event={"ID":"f9a83391-6937-45b0-9f86-8b6ce6b07ed7","Type":"ContainerDied","Data":"1844ac408f831fe7e5bacd004279abea911a4212d7e774dbe86e529a4a0f824b"}
Jul 17 11:25:03.744507 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:03.744411    2562 scope.go:117] "RemoveContainer" containerID="28d082803a79a95af9310f220540c503bbc307603a02ffde7026f7fbbbb4bd27"
Jul 17 11:25:03.761405 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:03.761379    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"]
Jul 17 11:25:03.763754 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:03.763732    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-ndx9t"]
Jul 17 11:25:05.680026 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:05.679992    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" path="/var/lib/kubelet/pods/f9a83391-6937-45b0-9f86-8b6ce6b07ed7/volumes"
Jul 17 11:25:42.328970 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.328901    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"]
Jul 17 11:25:42.329396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329290    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:25:42.329396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329303    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:25:42.329396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329313    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:25:42.329396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329319    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:25:42.329396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329331    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:25:42.329396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329337    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65357250-4add-4f1d-86fb-bd023e89c484" containerName="revoke-keys"
Jul 17 11:25:42.329396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329399    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:25:42.329615 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329407    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:25:42.329615 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.329415    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:25:42.332297 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.332282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"
Jul 17 11:25:42.334874 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.334846    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:25:42.334984 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.334914    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:25:42.340909 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.340885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"]
Jul 17 11:25:42.409552 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.409516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70afd63a-4c8f-4ea4-b57c-cb3fd474c13a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph\" (UID: \"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"
Jul 17 11:25:42.510914 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.510872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70afd63a-4c8f-4ea4-b57c-cb3fd474c13a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph\" (UID: \"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"
Jul 17 11:25:42.511543 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.511522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70afd63a-4c8f-4ea4-b57c-cb3fd474c13a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph\" (UID: \"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"
Jul 17 11:25:42.643760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.643730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"
Jul 17 11:25:42.993046 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:42.993010    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"]
Jul 17 11:25:42.995510 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:25:42.995475    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70afd63a_4c8f_4ea4_b57c_cb3fd474c13a.slice/crio-7d940c49eced365760c11c2180c1b2dc56f53ef2dfe09f54dc13fa09b05a979b WatchSource:0}: Error finding container 7d940c49eced365760c11c2180c1b2dc56f53ef2dfe09f54dc13fa09b05a979b: Status 404 returned error can't find the container with id 7d940c49eced365760c11c2180c1b2dc56f53ef2dfe09f54dc13fa09b05a979b
Jul 17 11:25:43.944383 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:43.944286    2562 generic.go:356] "Generic (PLEG): container finished" podID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerID="bbc113231408160b064470c3774429357a6a8c29562b17b9b87d4b2da1f3cd50" exitCode=7
Jul 17 11:25:43.944383 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:43.944370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" event={"ID":"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a","Type":"ContainerDied","Data":"bbc113231408160b064470c3774429357a6a8c29562b17b9b87d4b2da1f3cd50"}
Jul 17 11:25:43.944892 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:43.944425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" event={"ID":"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a","Type":"ContainerStarted","Data":"7d940c49eced365760c11c2180c1b2dc56f53ef2dfe09f54dc13fa09b05a979b"}
Jul 17 11:25:43.944892 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:43.944560    2562 scope.go:117] "RemoveContainer" containerID="bbc113231408160b064470c3774429357a6a8c29562b17b9b87d4b2da1f3cd50"
Jul 17 11:25:44.950879 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:44.950843    2562 generic.go:356] "Generic (PLEG): container finished" podID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerID="3dfe1fc3b51c728800da4c38581eb88ff4491fa38d87090d5fa2a90a443f2404" exitCode=7
Jul 17 11:25:44.951467 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:44.950927    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" event={"ID":"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a","Type":"ContainerDied","Data":"3dfe1fc3b51c728800da4c38581eb88ff4491fa38d87090d5fa2a90a443f2404"}
Jul 17 11:25:44.951467 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:44.950984    2562 scope.go:117] "RemoveContainer" containerID="bbc113231408160b064470c3774429357a6a8c29562b17b9b87d4b2da1f3cd50"
Jul 17 11:25:44.951467 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:44.951234    2562 scope.go:117] "RemoveContainer" containerID="3dfe1fc3b51c728800da4c38581eb88ff4491fa38d87090d5fa2a90a443f2404"
Jul 17 11:25:44.951639 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:25:44.951501    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph_odh-ai-gateway-infra(70afd63a-4c8f-4ea4-b57c-cb3fd474c13a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a"
Jul 17 11:25:45.957992 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:25:45.957969    2562 scope.go:117] "RemoveContainer" containerID="3dfe1fc3b51c728800da4c38581eb88ff4491fa38d87090d5fa2a90a443f2404"
Jul 17 11:25:45.958497 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:25:45.958224    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph_odh-ai-gateway-infra(70afd63a-4c8f-4ea4-b57c-cb3fd474c13a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a"
Jul 17 11:26:00.674935 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:00.674903    2562 scope.go:117] "RemoveContainer" containerID="3dfe1fc3b51c728800da4c38581eb88ff4491fa38d87090d5fa2a90a443f2404"
Jul 17 11:26:01.033233 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:01.033196    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" event={"ID":"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a","Type":"ContainerStarted","Data":"faa8ec57b2c1ae61d19bcddcb612e92b4632f4c46c709fd70e34e46869f060bd"}
Jul 17 11:26:01.053346 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:01.053287    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" podStartSLOduration=19.053269999 podStartE2EDuration="19.053269999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:25:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:26:01.051193804 +0000 UTC m=+2001.856219283" watchObservedRunningTime="2026-07-17 11:26:01.053269999 +0000 UTC m=+2001.858295484"
Jul 17 11:26:02.039545 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:02.039507    2562 generic.go:356] "Generic (PLEG): container finished" podID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerID="faa8ec57b2c1ae61d19bcddcb612e92b4632f4c46c709fd70e34e46869f060bd" exitCode=7
Jul 17 11:26:02.039964 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:02.039557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" event={"ID":"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a","Type":"ContainerDied","Data":"faa8ec57b2c1ae61d19bcddcb612e92b4632f4c46c709fd70e34e46869f060bd"}
Jul 17 11:26:02.039964 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:02.039614    2562 scope.go:117] "RemoveContainer" containerID="3dfe1fc3b51c728800da4c38581eb88ff4491fa38d87090d5fa2a90a443f2404"
Jul 17 11:26:02.039964 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:02.039929    2562 scope.go:117] "RemoveContainer" containerID="faa8ec57b2c1ae61d19bcddcb612e92b4632f4c46c709fd70e34e46869f060bd"
Jul 17 11:26:02.040177 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:26:02.040153    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph_odh-ai-gateway-infra(70afd63a-4c8f-4ea4-b57c-cb3fd474c13a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a"
Jul 17 11:26:02.063626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:02.063601    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"]
Jul 17 11:26:03.182506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:03.182482    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"
Jul 17 11:26:03.299247 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:03.299151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70afd63a-4c8f-4ea4-b57c-cb3fd474c13a-maas-api-service-ca\") pod \"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a\" (UID: \"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a\") "
Jul 17 11:26:03.299498 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:03.299474    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70afd63a-4c8f-4ea4-b57c-cb3fd474c13a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" (UID: "70afd63a-4c8f-4ea4-b57c-cb3fd474c13a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:26:03.400790 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:03.400738    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70afd63a-4c8f-4ea4-b57c-cb3fd474c13a-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:26:04.051944 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:04.051850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph" event={"ID":"70afd63a-4c8f-4ea4-b57c-cb3fd474c13a","Type":"ContainerDied","Data":"7d940c49eced365760c11c2180c1b2dc56f53ef2dfe09f54dc13fa09b05a979b"}
Jul 17 11:26:04.051944 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:04.051878    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"
Jul 17 11:26:04.051944 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:04.051924    2562 scope.go:117] "RemoveContainer" containerID="faa8ec57b2c1ae61d19bcddcb612e92b4632f4c46c709fd70e34e46869f060bd"
Jul 17 11:26:04.068659 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:04.068631    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"]
Jul 17 11:26:04.077154 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:04.077121    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-zgrph"]
Jul 17 11:26:05.680217 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:05.680181    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" path="/var/lib/kubelet/pods/70afd63a-4c8f-4ea4-b57c-cb3fd474c13a/volumes"
Jul 17 11:26:09.687311 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:09.687278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:26:42.392148 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392113    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"]
Jul 17 11:26:42.392551 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392522    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:26:42.392551 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392534    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:26:42.392551 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392550    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:26:42.392662 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392557    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:26:42.392662 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392568    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:26:42.392662 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392577    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a83391-6937-45b0-9f86-8b6ce6b07ed7" containerName="revoke-keys"
Jul 17 11:26:42.392662 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392641    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:26:42.392662 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.392652    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:26:42.396002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.395982    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"
Jul 17 11:26:42.398469 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.398445    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:26:42.398578 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.398469    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:26:42.402540 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.402514    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"]
Jul 17 11:26:42.533188 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.533153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c8ce4e-b6b5-4d54-8139-06d6825f4039-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8\" (UID: \"d1c8ce4e-b6b5-4d54-8139-06d6825f4039\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"
Jul 17 11:26:42.634195 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.634160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c8ce4e-b6b5-4d54-8139-06d6825f4039-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8\" (UID: \"d1c8ce4e-b6b5-4d54-8139-06d6825f4039\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"
Jul 17 11:26:42.634790 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.634770    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c8ce4e-b6b5-4d54-8139-06d6825f4039-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8\" (UID: \"d1c8ce4e-b6b5-4d54-8139-06d6825f4039\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"
Jul 17 11:26:42.709184 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.709112    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"
Jul 17 11:26:42.843109 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:42.843017    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"]
Jul 17 11:26:42.845563 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:26:42.845520    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c8ce4e_b6b5_4d54_8139_06d6825f4039.slice/crio-76935f975538f9a6ed38e95ef6ed0343480ded9edd81e088d15f7ecbcf64948c WatchSource:0}: Error finding container 76935f975538f9a6ed38e95ef6ed0343480ded9edd81e088d15f7ecbcf64948c: Status 404 returned error can't find the container with id 76935f975538f9a6ed38e95ef6ed0343480ded9edd81e088d15f7ecbcf64948c
Jul 17 11:26:43.235421 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:43.235383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" event={"ID":"d1c8ce4e-b6b5-4d54-8139-06d6825f4039","Type":"ContainerStarted","Data":"6518ec54b7ea00b5bb4db0810806917ed18a471959275a23aad7fa33e7752eee"}
Jul 17 11:26:43.235595 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:43.235464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" event={"ID":"d1c8ce4e-b6b5-4d54-8139-06d6825f4039","Type":"ContainerStarted","Data":"76935f975538f9a6ed38e95ef6ed0343480ded9edd81e088d15f7ecbcf64948c"}
Jul 17 11:26:43.251848 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:43.251797    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" podStartSLOduration=1.251783437 podStartE2EDuration="1.251783437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:26:43.250598592 +0000 UTC m=+2044.055624080" watchObservedRunningTime="2026-07-17 11:26:43.251783437 +0000 UTC m=+2044.056809312"
Jul 17 11:26:44.241238 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:44.241205    2562 generic.go:356] "Generic (PLEG): container finished" podID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerID="6518ec54b7ea00b5bb4db0810806917ed18a471959275a23aad7fa33e7752eee" exitCode=7
Jul 17 11:26:44.241621 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:44.241263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" event={"ID":"d1c8ce4e-b6b5-4d54-8139-06d6825f4039","Type":"ContainerDied","Data":"6518ec54b7ea00b5bb4db0810806917ed18a471959275a23aad7fa33e7752eee"}
Jul 17 11:26:44.241621 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:44.241451    2562 scope.go:117] "RemoveContainer" containerID="6518ec54b7ea00b5bb4db0810806917ed18a471959275a23aad7fa33e7752eee"
Jul 17 11:26:45.248845 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:45.248807    2562 generic.go:356] "Generic (PLEG): container finished" podID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerID="2b06dbf11477f346fc5aafd9a9c97f6ebf28012eef942b448817f281b600006e" exitCode=7
Jul 17 11:26:45.248845 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:45.248848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" event={"ID":"d1c8ce4e-b6b5-4d54-8139-06d6825f4039","Type":"ContainerDied","Data":"2b06dbf11477f346fc5aafd9a9c97f6ebf28012eef942b448817f281b600006e"}
Jul 17 11:26:45.249388 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:45.248906    2562 scope.go:117] "RemoveContainer" containerID="6518ec54b7ea00b5bb4db0810806917ed18a471959275a23aad7fa33e7752eee"
Jul 17 11:26:45.249388 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:45.249134    2562 scope.go:117] "RemoveContainer" containerID="2b06dbf11477f346fc5aafd9a9c97f6ebf28012eef942b448817f281b600006e"
Jul 17 11:26:45.249388 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:26:45.249362    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8_odh-ai-gateway-infra(d1c8ce4e-b6b5-4d54-8139-06d6825f4039)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039"
Jul 17 11:26:46.254940 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:46.254912    2562 scope.go:117] "RemoveContainer" containerID="2b06dbf11477f346fc5aafd9a9c97f6ebf28012eef942b448817f281b600006e"
Jul 17 11:26:46.255435 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:26:46.255191    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8_odh-ai-gateway-infra(d1c8ce4e-b6b5-4d54-8139-06d6825f4039)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039"
Jul 17 11:26:59.677029 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:26:59.677000    2562 scope.go:117] "RemoveContainer" containerID="2b06dbf11477f346fc5aafd9a9c97f6ebf28012eef942b448817f281b600006e"
Jul 17 11:27:00.324260 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:00.324182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" event={"ID":"d1c8ce4e-b6b5-4d54-8139-06d6825f4039","Type":"ContainerStarted","Data":"d8246db7b98ace598a244db36d06f80ba122d9806e2d22f4ef78799beaacce29"}
Jul 17 11:27:01.330382 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:01.330342    2562 generic.go:356] "Generic (PLEG): container finished" podID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerID="d8246db7b98ace598a244db36d06f80ba122d9806e2d22f4ef78799beaacce29" exitCode=7
Jul 17 11:27:01.330799 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:01.330412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" event={"ID":"d1c8ce4e-b6b5-4d54-8139-06d6825f4039","Type":"ContainerDied","Data":"d8246db7b98ace598a244db36d06f80ba122d9806e2d22f4ef78799beaacce29"}
Jul 17 11:27:01.330799 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:01.330471    2562 scope.go:117] "RemoveContainer" containerID="2b06dbf11477f346fc5aafd9a9c97f6ebf28012eef942b448817f281b600006e"
Jul 17 11:27:01.330799 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:01.330735    2562 scope.go:117] "RemoveContainer" containerID="d8246db7b98ace598a244db36d06f80ba122d9806e2d22f4ef78799beaacce29"
Jul 17 11:27:01.330965 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:27:01.330946    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8_odh-ai-gateway-infra(d1c8ce4e-b6b5-4d54-8139-06d6825f4039)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039"
Jul 17 11:27:01.361132 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:01.357546    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"]
Jul 17 11:27:02.471216 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:02.471188    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"
Jul 17 11:27:02.524995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:02.524966    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:27:02.616451 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:02.616424    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c8ce4e-b6b5-4d54-8139-06d6825f4039-maas-api-service-ca\") pod \"d1c8ce4e-b6b5-4d54-8139-06d6825f4039\" (UID: \"d1c8ce4e-b6b5-4d54-8139-06d6825f4039\") "
Jul 17 11:27:02.616789 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:02.616765    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c8ce4e-b6b5-4d54-8139-06d6825f4039-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d1c8ce4e-b6b5-4d54-8139-06d6825f4039" (UID: "d1c8ce4e-b6b5-4d54-8139-06d6825f4039"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:27:02.717929 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:02.717897    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1c8ce4e-b6b5-4d54-8139-06d6825f4039-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:27:03.342836 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:03.342808    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"
Jul 17 11:27:03.343019 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:03.342811    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8" event={"ID":"d1c8ce4e-b6b5-4d54-8139-06d6825f4039","Type":"ContainerDied","Data":"76935f975538f9a6ed38e95ef6ed0343480ded9edd81e088d15f7ecbcf64948c"}
Jul 17 11:27:03.343019 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:03.342943    2562 scope.go:117] "RemoveContainer" containerID="d8246db7b98ace598a244db36d06f80ba122d9806e2d22f4ef78799beaacce29"
Jul 17 11:27:03.369446 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:03.369416    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"]
Jul 17 11:27:03.371919 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:03.371894    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-nsqb8"]
Jul 17 11:27:03.680053 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:03.680017    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" path="/var/lib/kubelet/pods/d1c8ce4e-b6b5-4d54-8139-06d6825f4039/volumes"
Jul 17 11:27:04.279091 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:04.279045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:27:04.542268 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:04.542183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:27:04.643282 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:04.643250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:27:42.446980 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.446944    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"]
Jul 17 11:27:42.447394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447321    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:27:42.447394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447333    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:27:42.447394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447353    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:27:42.447394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447358    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:27:42.447394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447368    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:27:42.447394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447374    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:27:42.447610 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447427    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:27:42.447610 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447433    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:27:42.447610 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.447442    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="70afd63a-4c8f-4ea4-b57c-cb3fd474c13a" containerName="revoke-keys"
Jul 17 11:27:42.450564 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.450545    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"
Jul 17 11:27:42.453070 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.453044    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:27:42.453070 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.453060    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:27:42.459152 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.459132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"]
Jul 17 11:27:42.565369 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.565342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0085dcca-bb96-4326-9d11-225c6c095294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk\" (UID: \"0085dcca-bb96-4326-9d11-225c6c095294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"
Jul 17 11:27:42.666613 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.666583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0085dcca-bb96-4326-9d11-225c6c095294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk\" (UID: \"0085dcca-bb96-4326-9d11-225c6c095294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"
Jul 17 11:27:42.667166 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.667149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0085dcca-bb96-4326-9d11-225c6c095294-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk\" (UID: \"0085dcca-bb96-4326-9d11-225c6c095294\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"
Jul 17 11:27:42.762268 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.762174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"
Jul 17 11:27:42.892428 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:42.892405    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"]
Jul 17 11:27:42.894480 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:27:42.894449    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0085dcca_bb96_4326_9d11_225c6c095294.slice/crio-74fab00af768fc573e3a4a7239e0ed0cbac8c4e3cf625deb0ccaa5bbf0ec5c24 WatchSource:0}: Error finding container 74fab00af768fc573e3a4a7239e0ed0cbac8c4e3cf625deb0ccaa5bbf0ec5c24: Status 404 returned error can't find the container with id 74fab00af768fc573e3a4a7239e0ed0cbac8c4e3cf625deb0ccaa5bbf0ec5c24
Jul 17 11:27:43.530635 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:43.530592    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" event={"ID":"0085dcca-bb96-4326-9d11-225c6c095294","Type":"ContainerStarted","Data":"755e4dd36aaeb6871667010598a8856c1c6d1cf5b3ca1f6a31f0c380cd60f3d2"}
Jul 17 11:27:43.530995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:43.530665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" event={"ID":"0085dcca-bb96-4326-9d11-225c6c095294","Type":"ContainerStarted","Data":"74fab00af768fc573e3a4a7239e0ed0cbac8c4e3cf625deb0ccaa5bbf0ec5c24"}
Jul 17 11:27:43.546970 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:43.546926    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" podStartSLOduration=1.546912062 podStartE2EDuration="1.546912062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:27:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:27:43.545123561 +0000 UTC m=+2104.350149045" watchObservedRunningTime="2026-07-17 11:27:43.546912062 +0000 UTC m=+2104.351937546"
Jul 17 11:27:44.536736 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:44.536699    2562 generic.go:356] "Generic (PLEG): container finished" podID="0085dcca-bb96-4326-9d11-225c6c095294" containerID="755e4dd36aaeb6871667010598a8856c1c6d1cf5b3ca1f6a31f0c380cd60f3d2" exitCode=7
Jul 17 11:27:44.537150 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:44.536782    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" event={"ID":"0085dcca-bb96-4326-9d11-225c6c095294","Type":"ContainerDied","Data":"755e4dd36aaeb6871667010598a8856c1c6d1cf5b3ca1f6a31f0c380cd60f3d2"}
Jul 17 11:27:44.537150 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:44.536931    2562 scope.go:117] "RemoveContainer" containerID="755e4dd36aaeb6871667010598a8856c1c6d1cf5b3ca1f6a31f0c380cd60f3d2"
Jul 17 11:27:45.543933 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:45.543841    2562 generic.go:356] "Generic (PLEG): container finished" podID="0085dcca-bb96-4326-9d11-225c6c095294" containerID="d7956bf3a91afd7a4c4b0471f59b9067dac0f7b2af392ea13c78f2d8eba674c8" exitCode=7
Jul 17 11:27:45.544371 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:45.543931    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" event={"ID":"0085dcca-bb96-4326-9d11-225c6c095294","Type":"ContainerDied","Data":"d7956bf3a91afd7a4c4b0471f59b9067dac0f7b2af392ea13c78f2d8eba674c8"}
Jul 17 11:27:45.544371 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:45.543992    2562 scope.go:117] "RemoveContainer" containerID="755e4dd36aaeb6871667010598a8856c1c6d1cf5b3ca1f6a31f0c380cd60f3d2"
Jul 17 11:27:45.544371 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:45.544197    2562 scope.go:117] "RemoveContainer" containerID="d7956bf3a91afd7a4c4b0471f59b9067dac0f7b2af392ea13c78f2d8eba674c8"
Jul 17 11:27:45.544498 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:27:45.544404    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk_odh-ai-gateway-infra(0085dcca-bb96-4326-9d11-225c6c095294)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" podUID="0085dcca-bb96-4326-9d11-225c6c095294"
Jul 17 11:27:46.550774 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:46.550740    2562 scope.go:117] "RemoveContainer" containerID="d7956bf3a91afd7a4c4b0471f59b9067dac0f7b2af392ea13c78f2d8eba674c8"
Jul 17 11:27:46.551275 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:27:46.550982    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk_odh-ai-gateway-infra(0085dcca-bb96-4326-9d11-225c6c095294)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" podUID="0085dcca-bb96-4326-9d11-225c6c095294"
Jul 17 11:27:57.675131 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:57.675068    2562 scope.go:117] "RemoveContainer" containerID="d7956bf3a91afd7a4c4b0471f59b9067dac0f7b2af392ea13c78f2d8eba674c8"
Jul 17 11:27:58.611492 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:58.611276    2562 generic.go:356] "Generic (PLEG): container finished" podID="0085dcca-bb96-4326-9d11-225c6c095294" containerID="63645ff87369a114c3543d028c0b56aac1c4e09233740aa18f84e2e8d0e05376" exitCode=7
Jul 17 11:27:58.611492 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:58.611386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" event={"ID":"0085dcca-bb96-4326-9d11-225c6c095294","Type":"ContainerDied","Data":"63645ff87369a114c3543d028c0b56aac1c4e09233740aa18f84e2e8d0e05376"}
Jul 17 11:27:58.614459 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:58.611778    2562 scope.go:117] "RemoveContainer" containerID="d7956bf3a91afd7a4c4b0471f59b9067dac0f7b2af392ea13c78f2d8eba674c8"
Jul 17 11:27:58.614459 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:58.612314    2562 scope.go:117] "RemoveContainer" containerID="63645ff87369a114c3543d028c0b56aac1c4e09233740aa18f84e2e8d0e05376"
Jul 17 11:27:58.614459 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:27:58.612708    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk_odh-ai-gateway-infra(0085dcca-bb96-4326-9d11-225c6c095294)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" podUID="0085dcca-bb96-4326-9d11-225c6c095294"
Jul 17 11:27:59.661152 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:59.661119    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"]
Jul 17 11:27:59.795160 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:59.795133    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"
Jul 17 11:27:59.829278 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:59.829251    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0085dcca-bb96-4326-9d11-225c6c095294-maas-api-service-ca\") pod \"0085dcca-bb96-4326-9d11-225c6c095294\" (UID: \"0085dcca-bb96-4326-9d11-225c6c095294\") "
Jul 17 11:27:59.829669 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:59.829643    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0085dcca-bb96-4326-9d11-225c6c095294-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0085dcca-bb96-4326-9d11-225c6c095294" (UID: "0085dcca-bb96-4326-9d11-225c6c095294"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:27:59.930384 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:27:59.930305    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0085dcca-bb96-4326-9d11-225c6c095294-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:28:00.623359 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:00.623327    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"
Jul 17 11:28:00.623518 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:00.623330    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk" event={"ID":"0085dcca-bb96-4326-9d11-225c6c095294","Type":"ContainerDied","Data":"74fab00af768fc573e3a4a7239e0ed0cbac8c4e3cf625deb0ccaa5bbf0ec5c24"}
Jul 17 11:28:00.623518 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:00.623462    2562 scope.go:117] "RemoveContainer" containerID="63645ff87369a114c3543d028c0b56aac1c4e09233740aa18f84e2e8d0e05376"
Jul 17 11:28:00.646188 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:00.646159    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"]
Jul 17 11:28:00.651061 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:00.651040    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vt9gk"]
Jul 17 11:28:01.679932 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:01.679900    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0085dcca-bb96-4326-9d11-225c6c095294" path="/var/lib/kubelet/pods/0085dcca-bb96-4326-9d11-225c6c095294/volumes"
Jul 17 11:28:21.369939 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:21.369898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:28:32.509416 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509334    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"]
Jul 17 11:28:32.509772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509709    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:28:32.509772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509720    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:28:32.509772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509733    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:28:32.509772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509739    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:28:32.509772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509745    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:28:32.509772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509750    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:28:32.509959 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509817    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1c8ce4e-b6b5-4d54-8139-06d6825f4039" containerName="revoke-keys"
Jul 17 11:28:32.509959 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509827    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:28:32.509959 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.509834    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:28:32.512890 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.512873    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"
Jul 17 11:28:32.515813 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.515792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:28:32.515813 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.515804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:28:32.522360 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.522336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"]
Jul 17 11:28:32.619575 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.619539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe72d3a-85e8-47c9-be3b-785df6bd5c70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7\" (UID: \"dfe72d3a-85e8-47c9-be3b-785df6bd5c70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"
Jul 17 11:28:32.721100 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.721041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe72d3a-85e8-47c9-be3b-785df6bd5c70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7\" (UID: \"dfe72d3a-85e8-47c9-be3b-785df6bd5c70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"
Jul 17 11:28:32.721668 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.721647    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe72d3a-85e8-47c9-be3b-785df6bd5c70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7\" (UID: \"dfe72d3a-85e8-47c9-be3b-785df6bd5c70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"
Jul 17 11:28:32.824377 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.824295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"
Jul 17 11:28:32.955923 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:32.955892    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"]
Jul 17 11:28:32.959295 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:28:32.959261    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe72d3a_85e8_47c9_be3b_785df6bd5c70.slice/crio-ecfec07b0e3e3a532816ef831ef814086c96e1d70f870426979ce9660406e240 WatchSource:0}: Error finding container ecfec07b0e3e3a532816ef831ef814086c96e1d70f870426979ce9660406e240: Status 404 returned error can't find the container with id ecfec07b0e3e3a532816ef831ef814086c96e1d70f870426979ce9660406e240
Jul 17 11:28:33.775701 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:33.775609    2562 generic.go:356] "Generic (PLEG): container finished" podID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerID="c38a7a5b1c5a27322e6b9286c199f13b04e4e1c92d530d9626d9e0e074093eb2" exitCode=7
Jul 17 11:28:33.775701 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:33.775684    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7" event={"ID":"dfe72d3a-85e8-47c9-be3b-785df6bd5c70","Type":"ContainerDied","Data":"c38a7a5b1c5a27322e6b9286c199f13b04e4e1c92d530d9626d9e0e074093eb2"}
Jul 17 11:28:33.776189 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:33.775722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7" event={"ID":"dfe72d3a-85e8-47c9-be3b-785df6bd5c70","Type":"ContainerStarted","Data":"ecfec07b0e3e3a532816ef831ef814086c96e1d70f870426979ce9660406e240"}
Jul 17 11:28:33.776189 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:33.775894    2562 scope.go:117] "RemoveContainer" containerID="c38a7a5b1c5a27322e6b9286c199f13b04e4e1c92d530d9626d9e0e074093eb2"
Jul 17 11:28:34.782656 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:34.782564    2562 generic.go:356] "Generic (PLEG): container finished" podID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerID="150f814f7dfb8cba16eab37f8868ff83f4a8990dc415dedf0b36893773bab1d0" exitCode=7
Jul 17 11:28:34.783058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:34.782653    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7" event={"ID":"dfe72d3a-85e8-47c9-be3b-785df6bd5c70","Type":"ContainerDied","Data":"150f814f7dfb8cba16eab37f8868ff83f4a8990dc415dedf0b36893773bab1d0"}
Jul 17 11:28:34.783058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:34.782710    2562 scope.go:117] "RemoveContainer" containerID="c38a7a5b1c5a27322e6b9286c199f13b04e4e1c92d530d9626d9e0e074093eb2"
Jul 17 11:28:34.783058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:34.782809    2562 scope.go:117] "RemoveContainer" containerID="150f814f7dfb8cba16eab37f8868ff83f4a8990dc415dedf0b36893773bab1d0"
Jul 17 11:28:34.783058 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:28:34.783029    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7_odh-ai-gateway-infra(dfe72d3a-85e8-47c9-be3b-785df6bd5c70)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70"
Jul 17 11:28:35.793458 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:35.793429    2562 scope.go:117] "RemoveContainer" containerID="150f814f7dfb8cba16eab37f8868ff83f4a8990dc415dedf0b36893773bab1d0"
Jul 17 11:28:35.793915 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:28:35.793682    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7_odh-ai-gateway-infra(dfe72d3a-85e8-47c9-be3b-785df6bd5c70)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70"
Jul 17 11:28:49.678054 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:49.678020    2562 scope.go:117] "RemoveContainer" containerID="150f814f7dfb8cba16eab37f8868ff83f4a8990dc415dedf0b36893773bab1d0"
Jul 17 11:28:50.872573 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:50.872542    2562 generic.go:356] "Generic (PLEG): container finished" podID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerID="3d0fda7a66d3b22a63772f9e51097f04db42791146d889410adbb72a21c4b8f4" exitCode=7
Jul 17 11:28:50.873010 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:50.872617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7" event={"ID":"dfe72d3a-85e8-47c9-be3b-785df6bd5c70","Type":"ContainerDied","Data":"3d0fda7a66d3b22a63772f9e51097f04db42791146d889410adbb72a21c4b8f4"}
Jul 17 11:28:50.873010 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:50.872674    2562 scope.go:117] "RemoveContainer" containerID="150f814f7dfb8cba16eab37f8868ff83f4a8990dc415dedf0b36893773bab1d0"
Jul 17 11:28:50.873010 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:50.872908    2562 scope.go:117] "RemoveContainer" containerID="3d0fda7a66d3b22a63772f9e51097f04db42791146d889410adbb72a21c4b8f4"
Jul 17 11:28:50.873170 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:28:50.873148    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7_odh-ai-gateway-infra(dfe72d3a-85e8-47c9-be3b-785df6bd5c70)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70"
Jul 17 11:28:51.898984 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:51.898948    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"]
Jul 17 11:28:52.032598 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.032575    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"
Jul 17 11:28:52.099232 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.099195    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe72d3a-85e8-47c9-be3b-785df6bd5c70-maas-api-service-ca\") pod \"dfe72d3a-85e8-47c9-be3b-785df6bd5c70\" (UID: \"dfe72d3a-85e8-47c9-be3b-785df6bd5c70\") "
Jul 17 11:28:52.099535 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.099514    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfe72d3a-85e8-47c9-be3b-785df6bd5c70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dfe72d3a-85e8-47c9-be3b-785df6bd5c70" (UID: "dfe72d3a-85e8-47c9-be3b-785df6bd5c70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:28:52.200286 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.200210    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfe72d3a-85e8-47c9-be3b-785df6bd5c70-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:28:52.884852 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.884821    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"
Jul 17 11:28:52.884852 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.884832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7" event={"ID":"dfe72d3a-85e8-47c9-be3b-785df6bd5c70","Type":"ContainerDied","Data":"ecfec07b0e3e3a532816ef831ef814086c96e1d70f870426979ce9660406e240"}
Jul 17 11:28:52.885097 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.884897    2562 scope.go:117] "RemoveContainer" containerID="3d0fda7a66d3b22a63772f9e51097f04db42791146d889410adbb72a21c4b8f4"
Jul 17 11:28:52.906955 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.906930    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"]
Jul 17 11:28:52.910606 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:52.910582    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eac6ba90-vttx7"]
Jul 17 11:28:53.680150 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:28:53.680114    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" path="/var/lib/kubelet/pods/dfe72d3a-85e8-47c9-be3b-785df6bd5c70/volumes"
Jul 17 11:29:04.241817 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:04.241781    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"]
Jul 17 11:29:04.242262 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:04.242005    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy" containerID="cri-o://4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348" gracePeriod=30
Jul 17 11:29:04.254960 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:04.254931    2562 patch_prober.go:28] interesting pod/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 11:29:04.255101 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:04.254996    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 11:29:04.272583 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:04.272553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:04.389020 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:04.388994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:09.501642 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.501615    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:29:09.660836 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.660807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-envoy\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.660979 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.660866    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-certs\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.660979 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.660893    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-socket\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.660979 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.660946    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-token\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.660979 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.660971    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99649e92-6b8c-4e76-a6be-039d38979cd9-istiod-ca-cert\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.661180 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661154    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-podinfo\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.661180 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661172    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:29:09.661284 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661236    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:29:09.661284 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661251    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-credential-socket\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.661284 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661278    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-data\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.661452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661334    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nmhk\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-kube-api-access-4nmhk\") pod \"99649e92-6b8c-4e76-a6be-039d38979cd9\" (UID: \"99649e92-6b8c-4e76-a6be-039d38979cd9\") "
Jul 17 11:29:09.661452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661405    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:29:09.661452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661431    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99649e92-6b8c-4e76-a6be-039d38979cd9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:29:09.661678 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661655    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.661678 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661677    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-workload-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.661859 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661686    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99649e92-6b8c-4e76-a6be-039d38979cd9-istiod-ca-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.661859 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.661695    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-credential-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.662160 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.662137    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-data" (OuterVolumeSpecName: "istio-data") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:29:09.663092 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.663056    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:29:09.663285 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.663259    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 11:29:09.663347 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.663293    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-token" (OuterVolumeSpecName: "istio-token") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:29:09.663426 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.663407    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-kube-api-access-4nmhk" (OuterVolumeSpecName: "kube-api-access-4nmhk") pod "99649e92-6b8c-4e76-a6be-039d38979cd9" (UID: "99649e92-6b8c-4e76-a6be-039d38979cd9"). InnerVolumeSpecName "kube-api-access-4nmhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:29:09.762725 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.762698    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-data\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.762725 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.762722    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nmhk\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-kube-api-access-4nmhk\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.762893 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.762733    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-envoy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.762893 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.762743    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-token\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.762893 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.762750    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99649e92-6b8c-4e76-a6be-039d38979cd9-istio-podinfo\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:09.809857 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.809778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:09.964823 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.964781    2562 generic.go:356] "Generic (PLEG): container finished" podID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerID="4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348" exitCode=0
Jul 17 11:29:09.965002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.964835    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"
Jul 17 11:29:09.965002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.964878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" event={"ID":"99649e92-6b8c-4e76-a6be-039d38979cd9","Type":"ContainerDied","Data":"4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348"}
Jul 17 11:29:09.965002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.964926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct" event={"ID":"99649e92-6b8c-4e76-a6be-039d38979cd9","Type":"ContainerDied","Data":"69ab6da447f84df1597a485c248da7cb636c97e78b6ea91d02aacf9043db8473"}
Jul 17 11:29:09.965002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.964948    2562 scope.go:117] "RemoveContainer" containerID="4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348"
Jul 17 11:29:09.973817 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.973801    2562 scope.go:117] "RemoveContainer" containerID="8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea"
Jul 17 11:29:09.981631 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.981535    2562 scope.go:117] "RemoveContainer" containerID="4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348"
Jul 17 11:29:09.981866 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:29:09.981845    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348\": container with ID starting with 4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348 not found: ID does not exist" containerID="4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348"
Jul 17 11:29:09.981951 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.981879    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348"} err="failed to get container status \"4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348\": rpc error: code = NotFound desc = could not find container \"4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348\": container with ID starting with 4ac77e622864f1c401ba10c3b55bfdc9968d3467653bb9af614c9c4f5ab3f348 not found: ID does not exist"
Jul 17 11:29:09.981951 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.981902    2562 scope.go:117] "RemoveContainer" containerID="8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea"
Jul 17 11:29:09.982212 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:29:09.982192    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea\": container with ID starting with 8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea not found: ID does not exist" containerID="8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea"
Jul 17 11:29:09.982272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.982222    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea"} err="failed to get container status \"8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea\": rpc error: code = NotFound desc = could not find container \"8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea\": container with ID starting with 8efd00d4c0d7717091f5c50cf35b4693e9b60b2a4d5923582d8d4ac484358eea not found: ID does not exist"
Jul 17 11:29:09.983844 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.983825    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"]
Jul 17 11:29:09.987577 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:09.987554    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eac6ba90-openshift-default-846856b869-4xcct"]
Jul 17 11:29:10.905337 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:10.905303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:11.680633 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:11.680599    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" path="/var/lib/kubelet/pods/99649e92-6b8c-4e76-a6be-039d38979cd9/volumes"
Jul 17 11:29:16.387356 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:16.387311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:16.486889 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:16.486860    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:16.674026 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:16.673985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:17.946564 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:17.946527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:18.038661 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:18.038586    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:18.157501 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:18.157469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:18.505646 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:18.505599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:18.810853 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:18.810762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:18.918757 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:18.918723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:22.212574 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212543    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"]
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212905    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212919    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212926    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212934    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212952    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212958    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212964    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212969    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212985    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212990    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.212995    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.213041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.213000    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.213420 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.213064    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0085dcca-bb96-4326-9d11-225c6c095294" containerName="revoke-keys"
Jul 17 11:29:22.213420 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.213085    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.213420 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.213091    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy"
Jul 17 11:29:22.213420 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.213097    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.213420 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.213104    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe72d3a-85e8-47c9-be3b-785df6bd5c70" containerName="revoke-keys"
Jul 17 11:29:22.216165 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.216146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"
Jul 17 11:29:22.218878 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.218858    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:29:22.218970 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.218897    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:29:22.223554 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.223529    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"]
Jul 17 11:29:22.272937 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.272898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/648547cc-74c0-4f7c-aaa5-f9e2fa0916dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-jqlqj\" (UID: \"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"
Jul 17 11:29:22.373837 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.373801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/648547cc-74c0-4f7c-aaa5-f9e2fa0916dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-jqlqj\" (UID: \"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"
Jul 17 11:29:22.374470 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.374450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/648547cc-74c0-4f7c-aaa5-f9e2fa0916dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-jqlqj\" (UID: \"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"
Jul 17 11:29:22.527672 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.527568    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"
Jul 17 11:29:22.659883 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:22.659856    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"]
Jul 17 11:29:22.662890 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:29:22.662863    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648547cc_74c0_4f7c_aaa5_f9e2fa0916dd.slice/crio-c1c7dba453c64cf6129ddad8317dcca1a5e8f62f8fdaed9be01a2771b18e978e WatchSource:0}: Error finding container c1c7dba453c64cf6129ddad8317dcca1a5e8f62f8fdaed9be01a2771b18e978e: Status 404 returned error can't find the container with id c1c7dba453c64cf6129ddad8317dcca1a5e8f62f8fdaed9be01a2771b18e978e
Jul 17 11:29:23.028029 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:23.027995    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" event={"ID":"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd","Type":"ContainerStarted","Data":"806228f2849000ef895596ea742be85f6c23e8302687f705952fd47a438036a4"}
Jul 17 11:29:23.028206 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:23.028046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" event={"ID":"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd","Type":"ContainerStarted","Data":"c1c7dba453c64cf6129ddad8317dcca1a5e8f62f8fdaed9be01a2771b18e978e"}
Jul 17 11:29:23.045627 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:23.045580    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" podStartSLOduration=1.045564125 podStartE2EDuration="1.045564125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:29:23.044342958 +0000 UTC m=+2203.849368443" watchObservedRunningTime="2026-07-17 11:29:23.045564125 +0000 UTC m=+2203.850589608"
Jul 17 11:29:24.033880 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:24.033845    2562 generic.go:356] "Generic (PLEG): container finished" podID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerID="806228f2849000ef895596ea742be85f6c23e8302687f705952fd47a438036a4" exitCode=7
Jul 17 11:29:24.034301 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:24.033911    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" event={"ID":"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd","Type":"ContainerDied","Data":"806228f2849000ef895596ea742be85f6c23e8302687f705952fd47a438036a4"}
Jul 17 11:29:24.034301 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:24.034057    2562 scope.go:117] "RemoveContainer" containerID="806228f2849000ef895596ea742be85f6c23e8302687f705952fd47a438036a4"
Jul 17 11:29:25.040533 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:25.040443    2562 generic.go:356] "Generic (PLEG): container finished" podID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerID="3104dad55b43b0d048b94f7fc9a51e95f91daa0bc9aa5e2d52934aff5ae42e5a" exitCode=7
Jul 17 11:29:25.040533 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:25.040513    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" event={"ID":"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd","Type":"ContainerDied","Data":"3104dad55b43b0d048b94f7fc9a51e95f91daa0bc9aa5e2d52934aff5ae42e5a"}
Jul 17 11:29:25.041012 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:25.040566    2562 scope.go:117] "RemoveContainer" containerID="806228f2849000ef895596ea742be85f6c23e8302687f705952fd47a438036a4"
Jul 17 11:29:25.041012 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:25.040778    2562 scope.go:117] "RemoveContainer" containerID="3104dad55b43b0d048b94f7fc9a51e95f91daa0bc9aa5e2d52934aff5ae42e5a"
Jul 17 11:29:25.041012 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:29:25.040984    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-jqlqj_odh-ai-gateway-infra(648547cc-74c0-4f7c-aaa5-f9e2fa0916dd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd"
Jul 17 11:29:26.047151 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:26.047120    2562 scope.go:117] "RemoveContainer" containerID="3104dad55b43b0d048b94f7fc9a51e95f91daa0bc9aa5e2d52934aff5ae42e5a"
Jul 17 11:29:26.047523 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:29:26.047305    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-jqlqj_odh-ai-gateway-infra(648547cc-74c0-4f7c-aaa5-f9e2fa0916dd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd"
Jul 17 11:29:30.727325 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:30.727250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:30.825692 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:30.825665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:34.494799 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:34.494770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:29:41.674716 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:41.674680    2562 scope.go:117] "RemoveContainer" containerID="3104dad55b43b0d048b94f7fc9a51e95f91daa0bc9aa5e2d52934aff5ae42e5a"
Jul 17 11:29:42.125018 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:42.124982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" event={"ID":"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd","Type":"ContainerStarted","Data":"ff83e575b06c0ce07e462096b8569e16717b3c1a8c0b8243ba11b9e83fc48419"}
Jul 17 11:29:43.131046 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:43.131013    2562 generic.go:356] "Generic (PLEG): container finished" podID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerID="ff83e575b06c0ce07e462096b8569e16717b3c1a8c0b8243ba11b9e83fc48419" exitCode=7
Jul 17 11:29:43.131464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:43.131103    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" event={"ID":"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd","Type":"ContainerDied","Data":"ff83e575b06c0ce07e462096b8569e16717b3c1a8c0b8243ba11b9e83fc48419"}
Jul 17 11:29:43.131464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:43.131165    2562 scope.go:117] "RemoveContainer" containerID="3104dad55b43b0d048b94f7fc9a51e95f91daa0bc9aa5e2d52934aff5ae42e5a"
Jul 17 11:29:43.131464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:43.131446    2562 scope.go:117] "RemoveContainer" containerID="ff83e575b06c0ce07e462096b8569e16717b3c1a8c0b8243ba11b9e83fc48419"
Jul 17 11:29:43.131693 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:29:43.131673    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-jqlqj_odh-ai-gateway-infra(648547cc-74c0-4f7c-aaa5-f9e2fa0916dd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd"
Jul 17 11:29:43.183061 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:43.183036    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"]
Jul 17 11:29:44.269222 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:44.269199    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"
Jul 17 11:29:44.364912 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:44.364884    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/648547cc-74c0-4f7c-aaa5-f9e2fa0916dd-maas-api-service-ca\") pod \"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd\" (UID: \"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd\") "
Jul 17 11:29:44.365269 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:44.365243    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/648547cc-74c0-4f7c-aaa5-f9e2fa0916dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" (UID: "648547cc-74c0-4f7c-aaa5-f9e2fa0916dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:29:44.465886 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:44.465809    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/648547cc-74c0-4f7c-aaa5-f9e2fa0916dd-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:29:45.142720 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:45.142687    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"
Jul 17 11:29:45.142720 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:45.142708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj" event={"ID":"648547cc-74c0-4f7c-aaa5-f9e2fa0916dd","Type":"ContainerDied","Data":"c1c7dba453c64cf6129ddad8317dcca1a5e8f62f8fdaed9be01a2771b18e978e"}
Jul 17 11:29:45.142993 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:45.142763    2562 scope.go:117] "RemoveContainer" containerID="ff83e575b06c0ce07e462096b8569e16717b3c1a8c0b8243ba11b9e83fc48419"
Jul 17 11:29:45.165156 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:45.165130    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"]
Jul 17 11:29:45.166743 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:45.166715    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-jqlqj"]
Jul 17 11:29:45.680683 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:29:45.680648    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" path="/var/lib/kubelet/pods/648547cc-74c0-4f7c-aaa5-f9e2fa0916dd/volumes"
Jul 17 11:30:00.144799 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.144764    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"]
Jul 17 11:30:00.145271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.145137    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.145271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.145150    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.145271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.145162    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.145271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.145167    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.145271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.145238    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.145271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.145245    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.145271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.145254    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="99649e92-6b8c-4e76-a6be-039d38979cd9" containerName="istio-proxy"
Jul 17 11:30:00.149736 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.149717    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds"]
Jul 17 11:30:00.149848 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.149830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"
Jul 17 11:30:00.150038 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.150028    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.150084 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.150040    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.150151 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.150141    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="648547cc-74c0-4f7c-aaa5-f9e2fa0916dd" containerName="revoke-keys"
Jul 17 11:30:00.153065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.153051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds"
Jul 17 11:30:00.154129 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.154112    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:30:00.159587 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.159565    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds"]
Jul 17 11:30:00.162113 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.162070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"
Jul 17 11:30:00.164230 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.164209    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"]
Jul 17 11:30:00.170927 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.170906    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds"
Jul 17 11:30:00.321534 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:30:00.318894    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b590873_2188_4d0b_ae1e_20447fbf74a8.slice/crio-19335be4917fdb3b2283231bfaca9cfb92580261e2755f09c5bd5fb71fb63d90 WatchSource:0}: Error finding container 19335be4917fdb3b2283231bfaca9cfb92580261e2755f09c5bd5fb71fb63d90: Status 404 returned error can't find the container with id 19335be4917fdb3b2283231bfaca9cfb92580261e2755f09c5bd5fb71fb63d90
Jul 17 11:30:00.327386 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.327335    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"]
Jul 17 11:30:00.334155 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:00.334110    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds"]
Jul 17 11:30:00.336502 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:30:00.336475    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6573ade_e5b3_4e83_af80_3d585fc0b25e.slice/crio-edd4a6259634e3e52b07e5ec65e7d069d614df3dd048a3d92267149688f35024 WatchSource:0}: Error finding container edd4a6259634e3e52b07e5ec65e7d069d614df3dd048a3d92267149688f35024: Status 404 returned error can't find the container with id edd4a6259634e3e52b07e5ec65e7d069d614df3dd048a3d92267149688f35024
Jul 17 11:30:01.221235 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:01.221202    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerID="1edf803c8de2abf3edb859b1c277c767518d624f60c7d711f104a74a41a719a0" exitCode=7
Jul 17 11:30:01.221672 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:01.221287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" event={"ID":"0b590873-2188-4d0b-ae1e-20447fbf74a8","Type":"ContainerDied","Data":"1edf803c8de2abf3edb859b1c277c767518d624f60c7d711f104a74a41a719a0"}
Jul 17 11:30:01.221672 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:01.221352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" event={"ID":"0b590873-2188-4d0b-ae1e-20447fbf74a8","Type":"ContainerStarted","Data":"19335be4917fdb3b2283231bfaca9cfb92580261e2755f09c5bd5fb71fb63d90"}
Jul 17 11:30:01.221672 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:01.221456    2562 scope.go:117] "RemoveContainer" containerID="1edf803c8de2abf3edb859b1c277c767518d624f60c7d711f104a74a41a719a0"
Jul 17 11:30:01.223102 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:01.223064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds" event={"ID":"c6573ade-e5b3-4e83-af80-3d585fc0b25e","Type":"ContainerStarted","Data":"ca58bd76566b139c40e1ba564d9a3f00a24e09e2bc6f83232caa1608a1d43c02"}
Jul 17 11:30:01.223222 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:01.223131    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds" event={"ID":"c6573ade-e5b3-4e83-af80-3d585fc0b25e","Type":"ContainerStarted","Data":"edd4a6259634e3e52b07e5ec65e7d069d614df3dd048a3d92267149688f35024"}
Jul 17 11:30:01.253890 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:01.253843    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds" podStartSLOduration=1.253829347 podStartE2EDuration="1.253829347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:30:01.25202427 +0000 UTC m=+2242.057049755" watchObservedRunningTime="2026-07-17 11:30:01.253829347 +0000 UTC m=+2242.058854890"
Jul 17 11:30:02.229023 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:02.228937    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerID="11fe5025f10321e2c6215e9798f7d2c9b0e05e5e018d7ffdcb3575d2939c09e8" exitCode=7
Jul 17 11:30:02.229436 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:02.229021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" event={"ID":"0b590873-2188-4d0b-ae1e-20447fbf74a8","Type":"ContainerDied","Data":"11fe5025f10321e2c6215e9798f7d2c9b0e05e5e018d7ffdcb3575d2939c09e8"}
Jul 17 11:30:02.229436 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:02.229096    2562 scope.go:117] "RemoveContainer" containerID="1edf803c8de2abf3edb859b1c277c767518d624f60c7d711f104a74a41a719a0"
Jul 17 11:30:02.229436 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:02.229251    2562 scope.go:117] "RemoveContainer" containerID="11fe5025f10321e2c6215e9798f7d2c9b0e05e5e018d7ffdcb3575d2939c09e8"
Jul 17 11:30:02.229602 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:30:02.229495    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5_odh-ai-gateway-infra(0b590873-2188-4d0b-ae1e-20447fbf74a8)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8"
Jul 17 11:30:02.230784 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:02.230759    2562 generic.go:356] "Generic (PLEG): container finished" podID="c6573ade-e5b3-4e83-af80-3d585fc0b25e" containerID="ca58bd76566b139c40e1ba564d9a3f00a24e09e2bc6f83232caa1608a1d43c02" exitCode=0
Jul 17 11:30:02.230879 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:02.230813    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds" event={"ID":"c6573ade-e5b3-4e83-af80-3d585fc0b25e","Type":"ContainerDied","Data":"ca58bd76566b139c40e1ba564d9a3f00a24e09e2bc6f83232caa1608a1d43c02"}
Jul 17 11:30:03.236370 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:03.236348    2562 scope.go:117] "RemoveContainer" containerID="11fe5025f10321e2c6215e9798f7d2c9b0e05e5e018d7ffdcb3575d2939c09e8"
Jul 17 11:30:03.236761 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:30:03.236558    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5_odh-ai-gateway-infra(0b590873-2188-4d0b-ae1e-20447fbf74a8)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8"
Jul 17 11:30:03.365829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:03.365803    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds"
Jul 17 11:30:04.242554 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:04.242523    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds"
Jul 17 11:30:04.242936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:04.242557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738130-rq8ds" event={"ID":"c6573ade-e5b3-4e83-af80-3d585fc0b25e","Type":"ContainerDied","Data":"edd4a6259634e3e52b07e5ec65e7d069d614df3dd048a3d92267149688f35024"}
Jul 17 11:30:04.242936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:04.242606    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edd4a6259634e3e52b07e5ec65e7d069d614df3dd048a3d92267149688f35024"
Jul 17 11:30:16.674721 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:16.674691    2562 scope.go:117] "RemoveContainer" containerID="11fe5025f10321e2c6215e9798f7d2c9b0e05e5e018d7ffdcb3575d2939c09e8"
Jul 17 11:30:17.304738 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:17.304638    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" event={"ID":"0b590873-2188-4d0b-ae1e-20447fbf74a8","Type":"ContainerStarted","Data":"28127fedafcac7d8f59763077b4106e953e82c3807b711643a3846de8854751a"}
Jul 17 11:30:17.323583 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:17.323531    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" podStartSLOduration=17.323509259 podStartE2EDuration="17.323509259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:30:17.321677295 +0000 UTC m=+2258.126702778" watchObservedRunningTime="2026-07-17 11:30:17.323509259 +0000 UTC m=+2258.128534745"
Jul 17 11:30:18.311032 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:18.310999    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerID="28127fedafcac7d8f59763077b4106e953e82c3807b711643a3846de8854751a" exitCode=7
Jul 17 11:30:18.311425 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:18.311092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" event={"ID":"0b590873-2188-4d0b-ae1e-20447fbf74a8","Type":"ContainerDied","Data":"28127fedafcac7d8f59763077b4106e953e82c3807b711643a3846de8854751a"}
Jul 17 11:30:18.311425 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:18.311158    2562 scope.go:117] "RemoveContainer" containerID="11fe5025f10321e2c6215e9798f7d2c9b0e05e5e018d7ffdcb3575d2939c09e8"
Jul 17 11:30:18.311425 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:18.311365    2562 scope.go:117] "RemoveContainer" containerID="28127fedafcac7d8f59763077b4106e953e82c3807b711643a3846de8854751a"
Jul 17 11:30:18.311608 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:30:18.311588    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5_odh-ai-gateway-infra(0b590873-2188-4d0b-ae1e-20447fbf74a8)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8"
Jul 17 11:30:18.337461 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:18.337433    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"]
Jul 17 11:30:19.459678 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:19.459649    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"
Jul 17 11:30:20.323817 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:20.323783    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"
Jul 17 11:30:20.323817 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:20.323796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5" event={"ID":"0b590873-2188-4d0b-ae1e-20447fbf74a8","Type":"ContainerDied","Data":"19335be4917fdb3b2283231bfaca9cfb92580261e2755f09c5bd5fb71fb63d90"}
Jul 17 11:30:20.324044 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:20.323852    2562 scope.go:117] "RemoveContainer" containerID="28127fedafcac7d8f59763077b4106e953e82c3807b711643a3846de8854751a"
Jul 17 11:30:20.341772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:20.341742    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"]
Jul 17 11:30:20.345409 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:20.345385    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-71832244-29738130-4lrc5"]
Jul 17 11:30:21.681449 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:21.681418    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" path="/var/lib/kubelet/pods/0b590873-2188-4d0b-ae1e-20447fbf74a8/volumes"
Jul 17 11:30:22.273369 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273336    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"]
Jul 17 11:30:22.273713 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273699    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:30:22.273760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273716    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:30:22.273760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273729    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:30:22.273760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273734    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:30:22.273760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273742    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6573ade-e5b3-4e83-af80-3d585fc0b25e" containerName="cleanup"
Jul 17 11:30:22.273760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273747    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6573ade-e5b3-4e83-af80-3d585fc0b25e" containerName="cleanup"
Jul 17 11:30:22.273910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273813    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:30:22.273910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273822    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6573ade-e5b3-4e83-af80-3d585fc0b25e" containerName="cleanup"
Jul 17 11:30:22.273910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273828    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:30:22.273910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.273832    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:30:22.278158 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.278141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"
Jul 17 11:30:22.280759 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.280739    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:30:22.280878 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.280857    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:30:22.285104 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.285064    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"]
Jul 17 11:30:22.387444 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.387406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f014978-5557-40e0-ac6d-acf2230e7fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-j9w8d\" (UID: \"4f014978-5557-40e0-ac6d-acf2230e7fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"
Jul 17 11:30:22.488780 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.488738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f014978-5557-40e0-ac6d-acf2230e7fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-j9w8d\" (UID: \"4f014978-5557-40e0-ac6d-acf2230e7fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"
Jul 17 11:30:22.489407 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.489388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f014978-5557-40e0-ac6d-acf2230e7fdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-j9w8d\" (UID: \"4f014978-5557-40e0-ac6d-acf2230e7fdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"
Jul 17 11:30:22.589678 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.589601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"
Jul 17 11:30:22.722629 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:22.722598    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"]
Jul 17 11:30:22.725227 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:30:22.725201    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f014978_5557_40e0_ac6d_acf2230e7fdd.slice/crio-f15d0e22f9cae958cdc5146529d653341caac3741d3d444937a3cd6712115300 WatchSource:0}: Error finding container f15d0e22f9cae958cdc5146529d653341caac3741d3d444937a3cd6712115300: Status 404 returned error can't find the container with id f15d0e22f9cae958cdc5146529d653341caac3741d3d444937a3cd6712115300
Jul 17 11:30:23.343230 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:23.343200    2562 generic.go:356] "Generic (PLEG): container finished" podID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerID="dc107593547e63197e680412c061c2fbb0a949e6c973175e7d40ac860c6c2896" exitCode=7
Jul 17 11:30:23.343363 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:23.343292    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d" event={"ID":"4f014978-5557-40e0-ac6d-acf2230e7fdd","Type":"ContainerDied","Data":"dc107593547e63197e680412c061c2fbb0a949e6c973175e7d40ac860c6c2896"}
Jul 17 11:30:23.343363 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:23.343355    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d" event={"ID":"4f014978-5557-40e0-ac6d-acf2230e7fdd","Type":"ContainerStarted","Data":"f15d0e22f9cae958cdc5146529d653341caac3741d3d444937a3cd6712115300"}
Jul 17 11:30:23.343450 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:23.343425    2562 scope.go:117] "RemoveContainer" containerID="dc107593547e63197e680412c061c2fbb0a949e6c973175e7d40ac860c6c2896"
Jul 17 11:30:24.350104 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:24.350004    2562 generic.go:356] "Generic (PLEG): container finished" podID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerID="253fc7f9caef652f88a0362918d4cb74244ac34eee81f9b5c49b4d2a1f462269" exitCode=7
Jul 17 11:30:24.350104 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:24.350058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d" event={"ID":"4f014978-5557-40e0-ac6d-acf2230e7fdd","Type":"ContainerDied","Data":"253fc7f9caef652f88a0362918d4cb74244ac34eee81f9b5c49b4d2a1f462269"}
Jul 17 11:30:24.350595 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:24.350134    2562 scope.go:117] "RemoveContainer" containerID="dc107593547e63197e680412c061c2fbb0a949e6c973175e7d40ac860c6c2896"
Jul 17 11:30:24.350595 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:24.350320    2562 scope.go:117] "RemoveContainer" containerID="253fc7f9caef652f88a0362918d4cb74244ac34eee81f9b5c49b4d2a1f462269"
Jul 17 11:30:24.350595 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:30:24.350566    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-j9w8d_odh-ai-gateway-infra(4f014978-5557-40e0-ac6d-acf2230e7fdd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd"
Jul 17 11:30:25.356351 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:25.356321    2562 scope.go:117] "RemoveContainer" containerID="253fc7f9caef652f88a0362918d4cb74244ac34eee81f9b5c49b4d2a1f462269"
Jul 17 11:30:25.356724 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:30:25.356546    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-j9w8d_odh-ai-gateway-infra(4f014978-5557-40e0-ac6d-acf2230e7fdd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd"
Jul 17 11:30:36.675142 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:36.675113    2562 scope.go:117] "RemoveContainer" containerID="253fc7f9caef652f88a0362918d4cb74244ac34eee81f9b5c49b4d2a1f462269"
Jul 17 11:30:37.420376 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:37.420341    2562 generic.go:356] "Generic (PLEG): container finished" podID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerID="bc4d2956953afd5542171619813220487bcdc66ecc3fe4e5ed259d3acf486512" exitCode=7
Jul 17 11:30:37.420517 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:37.420411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d" event={"ID":"4f014978-5557-40e0-ac6d-acf2230e7fdd","Type":"ContainerDied","Data":"bc4d2956953afd5542171619813220487bcdc66ecc3fe4e5ed259d3acf486512"}
Jul 17 11:30:37.420517 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:37.420476    2562 scope.go:117] "RemoveContainer" containerID="253fc7f9caef652f88a0362918d4cb74244ac34eee81f9b5c49b4d2a1f462269"
Jul 17 11:30:37.420758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:37.420729    2562 scope.go:117] "RemoveContainer" containerID="bc4d2956953afd5542171619813220487bcdc66ecc3fe4e5ed259d3acf486512"
Jul 17 11:30:37.420999 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:30:37.420974    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-j9w8d_odh-ai-gateway-infra(4f014978-5557-40e0-ac6d-acf2230e7fdd)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd"
Jul 17 11:30:38.447262 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:38.447227    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"]
Jul 17 11:30:38.579482 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:38.579458    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"
Jul 17 11:30:38.635805 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:38.635775    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f014978-5557-40e0-ac6d-acf2230e7fdd-maas-api-service-ca\") pod \"4f014978-5557-40e0-ac6d-acf2230e7fdd\" (UID: \"4f014978-5557-40e0-ac6d-acf2230e7fdd\") "
Jul 17 11:30:38.636187 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:38.636161    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f014978-5557-40e0-ac6d-acf2230e7fdd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f014978-5557-40e0-ac6d-acf2230e7fdd" (UID: "4f014978-5557-40e0-ac6d-acf2230e7fdd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:30:38.737172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:38.737059    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f014978-5557-40e0-ac6d-acf2230e7fdd-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:30:39.433208 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:39.433172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d" event={"ID":"4f014978-5557-40e0-ac6d-acf2230e7fdd","Type":"ContainerDied","Data":"f15d0e22f9cae958cdc5146529d653341caac3741d3d444937a3cd6712115300"}
Jul 17 11:30:39.433400 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:39.433238    2562 scope.go:117] "RemoveContainer" containerID="bc4d2956953afd5542171619813220487bcdc66ecc3fe4e5ed259d3acf486512"
Jul 17 11:30:39.433400 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:39.433184    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"
Jul 17 11:30:39.453750 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:39.453725    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"]
Jul 17 11:30:39.458035 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:39.458008    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-j9w8d"]
Jul 17 11:30:39.686480 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:30:39.686404    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" path="/var/lib/kubelet/pods/4f014978-5557-40e0-ac6d-acf2230e7fdd/volumes"
Jul 17 11:31:12.325953 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.325898    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"]
Jul 17 11:31:12.326434 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.326303    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:31:12.326434 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.326314    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:31:12.326434 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.326327    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:31:12.326434 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.326332    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:31:12.326434 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.326341    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:31:12.326434 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.326346    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b590873-2188-4d0b-ae1e-20447fbf74a8" containerName="cleanup"
Jul 17 11:31:12.326434 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.326413    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:31:12.326434 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.326423    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:31:12.329603 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.329587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"
Jul 17 11:31:12.332621 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.332599    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:31:12.332756 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.332644    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:31:12.337625 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.337601    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"]
Jul 17 11:31:12.437071 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.437022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cedd47f7-1671-4e0c-ad04-e5099e4c73c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-tp8ts\" (UID: \"cedd47f7-1671-4e0c-ad04-e5099e4c73c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"
Jul 17 11:31:12.538572 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.538528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cedd47f7-1671-4e0c-ad04-e5099e4c73c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-tp8ts\" (UID: \"cedd47f7-1671-4e0c-ad04-e5099e4c73c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"
Jul 17 11:31:12.539195 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.539175    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cedd47f7-1671-4e0c-ad04-e5099e4c73c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-tp8ts\" (UID: \"cedd47f7-1671-4e0c-ad04-e5099e4c73c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"
Jul 17 11:31:12.641510 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.641475    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"
Jul 17 11:31:12.777255 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:12.777227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"]
Jul 17 11:31:12.779275 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:31:12.779249    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcedd47f7_1671_4e0c_ad04_e5099e4c73c6.slice/crio-81fb4cd25ec56576d034f7d9bc9f7af020e873b42bec07fae6f12b1c2c4e3672 WatchSource:0}: Error finding container 81fb4cd25ec56576d034f7d9bc9f7af020e873b42bec07fae6f12b1c2c4e3672: Status 404 returned error can't find the container with id 81fb4cd25ec56576d034f7d9bc9f7af020e873b42bec07fae6f12b1c2c4e3672
Jul 17 11:31:13.592004 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:13.591916    2562 generic.go:356] "Generic (PLEG): container finished" podID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerID="502e018288cb1b27eaa8b28bba8bc90d21bf6b814e3deac07e3673213c32a348" exitCode=7
Jul 17 11:31:13.592392 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:13.591998    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts" event={"ID":"cedd47f7-1671-4e0c-ad04-e5099e4c73c6","Type":"ContainerDied","Data":"502e018288cb1b27eaa8b28bba8bc90d21bf6b814e3deac07e3673213c32a348"}
Jul 17 11:31:13.592392 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:13.592052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts" event={"ID":"cedd47f7-1671-4e0c-ad04-e5099e4c73c6","Type":"ContainerStarted","Data":"81fb4cd25ec56576d034f7d9bc9f7af020e873b42bec07fae6f12b1c2c4e3672"}
Jul 17 11:31:13.592392 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:13.592214    2562 scope.go:117] "RemoveContainer" containerID="502e018288cb1b27eaa8b28bba8bc90d21bf6b814e3deac07e3673213c32a348"
Jul 17 11:31:14.598397 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:14.598298    2562 generic.go:356] "Generic (PLEG): container finished" podID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerID="6ae167a3b3e7149d267e1ac933df0884848b417d408a292638cece6695fa1aa6" exitCode=7
Jul 17 11:31:14.598397 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:14.598367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts" event={"ID":"cedd47f7-1671-4e0c-ad04-e5099e4c73c6","Type":"ContainerDied","Data":"6ae167a3b3e7149d267e1ac933df0884848b417d408a292638cece6695fa1aa6"}
Jul 17 11:31:14.598868 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:14.598418    2562 scope.go:117] "RemoveContainer" containerID="502e018288cb1b27eaa8b28bba8bc90d21bf6b814e3deac07e3673213c32a348"
Jul 17 11:31:14.598868 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:14.598555    2562 scope.go:117] "RemoveContainer" containerID="6ae167a3b3e7149d267e1ac933df0884848b417d408a292638cece6695fa1aa6"
Jul 17 11:31:14.598868 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:31:14.598797    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-tp8ts_odh-ai-gateway-infra(cedd47f7-1671-4e0c-ad04-e5099e4c73c6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6"
Jul 17 11:31:15.605162 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:15.605133    2562 scope.go:117] "RemoveContainer" containerID="6ae167a3b3e7149d267e1ac933df0884848b417d408a292638cece6695fa1aa6"
Jul 17 11:31:15.605558 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:31:15.605329    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-tp8ts_odh-ai-gateway-infra(cedd47f7-1671-4e0c-ad04-e5099e4c73c6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6"
Jul 17 11:31:26.675014 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:26.674988    2562 scope.go:117] "RemoveContainer" containerID="6ae167a3b3e7149d267e1ac933df0884848b417d408a292638cece6695fa1aa6"
Jul 17 11:31:27.663716 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:27.663677    2562 generic.go:356] "Generic (PLEG): container finished" podID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerID="159ed54adec07388de66688ce0801b7137229f835c510bd407e6c84b4565a119" exitCode=7
Jul 17 11:31:27.663882 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:27.663750    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts" event={"ID":"cedd47f7-1671-4e0c-ad04-e5099e4c73c6","Type":"ContainerDied","Data":"159ed54adec07388de66688ce0801b7137229f835c510bd407e6c84b4565a119"}
Jul 17 11:31:27.663882 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:27.663819    2562 scope.go:117] "RemoveContainer" containerID="6ae167a3b3e7149d267e1ac933df0884848b417d408a292638cece6695fa1aa6"
Jul 17 11:31:27.664138 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:27.664116    2562 scope.go:117] "RemoveContainer" containerID="159ed54adec07388de66688ce0801b7137229f835c510bd407e6c84b4565a119"
Jul 17 11:31:27.664390 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:31:27.664365    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-tp8ts_odh-ai-gateway-infra(cedd47f7-1671-4e0c-ad04-e5099e4c73c6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6"
Jul 17 11:31:28.700888 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:28.700854    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"]
Jul 17 11:31:28.843255 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:28.843229    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"
Jul 17 11:31:28.982494 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:28.982392    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cedd47f7-1671-4e0c-ad04-e5099e4c73c6-maas-api-service-ca\") pod \"cedd47f7-1671-4e0c-ad04-e5099e4c73c6\" (UID: \"cedd47f7-1671-4e0c-ad04-e5099e4c73c6\") "
Jul 17 11:31:28.982763 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:28.982741    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cedd47f7-1671-4e0c-ad04-e5099e4c73c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cedd47f7-1671-4e0c-ad04-e5099e4c73c6" (UID: "cedd47f7-1671-4e0c-ad04-e5099e4c73c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:31:29.083901 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:29.083873    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cedd47f7-1671-4e0c-ad04-e5099e4c73c6-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:31:29.677794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:29.677766    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"
Jul 17 11:31:29.681189 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:29.681160    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts" event={"ID":"cedd47f7-1671-4e0c-ad04-e5099e4c73c6","Type":"ContainerDied","Data":"81fb4cd25ec56576d034f7d9bc9f7af020e873b42bec07fae6f12b1c2c4e3672"}
Jul 17 11:31:29.681348 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:29.681209    2562 scope.go:117] "RemoveContainer" containerID="159ed54adec07388de66688ce0801b7137229f835c510bd407e6c84b4565a119"
Jul 17 11:31:29.705332 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:29.705303    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"]
Jul 17 11:31:29.709869 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:29.709848    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-tp8ts"]
Jul 17 11:31:31.680585 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:31:31.680509    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" path="/var/lib/kubelet/pods/cedd47f7-1671-4e0c-ad04-e5099e4c73c6/volumes"
Jul 17 11:32:02.382535 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382497    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"]
Jul 17 11:32:02.382910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382843    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:32:02.382910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382853    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:32:02.382910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382867    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:32:02.382910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382873    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:32:02.382910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382888    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:32:02.382910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382893    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:32:02.383124 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382967    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:32:02.383124 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382977    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:32:02.383124 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.382986    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f014978-5557-40e0-ac6d-acf2230e7fdd" containerName="revoke-keys"
Jul 17 11:32:02.386453 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.386437    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"
Jul 17 11:32:02.389116 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.389071    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:32:02.389256 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.389137    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:32:02.395699 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.395669    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"]
Jul 17 11:32:02.483837 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.483804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5104181-9564-4f75-9400-f64826fcf1fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-p4kc8\" (UID: \"d5104181-9564-4f75-9400-f64826fcf1fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"
Jul 17 11:32:02.585213 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.585183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5104181-9564-4f75-9400-f64826fcf1fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-p4kc8\" (UID: \"d5104181-9564-4f75-9400-f64826fcf1fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"
Jul 17 11:32:02.585834 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.585808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5104181-9564-4f75-9400-f64826fcf1fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-71832244-p4kc8\" (UID: \"d5104181-9564-4f75-9400-f64826fcf1fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"
Jul 17 11:32:02.698605 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.698530    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"
Jul 17 11:32:02.829635 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:02.829603    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"]
Jul 17 11:32:02.833837 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:32:02.833811    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5104181_9564_4f75_9400_f64826fcf1fe.slice/crio-13c90d5c3f4a996f0980afaab1fb0c78cdc7dda60124a75d1e334d059bedf78e WatchSource:0}: Error finding container 13c90d5c3f4a996f0980afaab1fb0c78cdc7dda60124a75d1e334d059bedf78e: Status 404 returned error can't find the container with id 13c90d5c3f4a996f0980afaab1fb0c78cdc7dda60124a75d1e334d059bedf78e
Jul 17 11:32:03.636185 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:03.636153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:03.725414 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:03.725381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:03.843847 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:03.843759    2562 generic.go:356] "Generic (PLEG): container finished" podID="d5104181-9564-4f75-9400-f64826fcf1fe" containerID="5730b02b698ccdb09b68e1d41ae82fdfb3fb46de3e79511b245450d6faabd1bd" exitCode=7
Jul 17 11:32:03.843847 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:03.843817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" event={"ID":"d5104181-9564-4f75-9400-f64826fcf1fe","Type":"ContainerDied","Data":"5730b02b698ccdb09b68e1d41ae82fdfb3fb46de3e79511b245450d6faabd1bd"}
Jul 17 11:32:03.844038 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:03.843874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" event={"ID":"d5104181-9564-4f75-9400-f64826fcf1fe","Type":"ContainerStarted","Data":"13c90d5c3f4a996f0980afaab1fb0c78cdc7dda60124a75d1e334d059bedf78e"}
Jul 17 11:32:03.844110 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:03.844096    2562 scope.go:117] "RemoveContainer" containerID="5730b02b698ccdb09b68e1d41ae82fdfb3fb46de3e79511b245450d6faabd1bd"
Jul 17 11:32:04.434050 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:04.433972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:04.850497 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:04.850405    2562 generic.go:356] "Generic (PLEG): container finished" podID="d5104181-9564-4f75-9400-f64826fcf1fe" containerID="d734f959c35cdcdaa85bab2c9c4a78c158caf1018b53c81be50dc9f9e00be9af" exitCode=7
Jul 17 11:32:04.850497 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:04.850452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" event={"ID":"d5104181-9564-4f75-9400-f64826fcf1fe","Type":"ContainerDied","Data":"d734f959c35cdcdaa85bab2c9c4a78c158caf1018b53c81be50dc9f9e00be9af"}
Jul 17 11:32:04.850986 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:04.850498    2562 scope.go:117] "RemoveContainer" containerID="5730b02b698ccdb09b68e1d41ae82fdfb3fb46de3e79511b245450d6faabd1bd"
Jul 17 11:32:04.850986 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:04.850660    2562 scope.go:117] "RemoveContainer" containerID="d734f959c35cdcdaa85bab2c9c4a78c158caf1018b53c81be50dc9f9e00be9af"
Jul 17 11:32:04.850986 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:32:04.850902    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-p4kc8_odh-ai-gateway-infra(d5104181-9564-4f75-9400-f64826fcf1fe)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" podUID="d5104181-9564-4f75-9400-f64826fcf1fe"
Jul 17 11:32:05.856931 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:05.856906    2562 scope.go:117] "RemoveContainer" containerID="d734f959c35cdcdaa85bab2c9c4a78c158caf1018b53c81be50dc9f9e00be9af"
Jul 17 11:32:05.857335 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:32:05.857133    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-p4kc8_odh-ai-gateway-infra(d5104181-9564-4f75-9400-f64826fcf1fe)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" podUID="d5104181-9564-4f75-9400-f64826fcf1fe"
Jul 17 11:32:05.948786 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:05.948737    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:20.674799 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:20.674765    2562 scope.go:117] "RemoveContainer" containerID="d734f959c35cdcdaa85bab2c9c4a78c158caf1018b53c81be50dc9f9e00be9af"
Jul 17 11:32:20.930049 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:20.929968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" event={"ID":"d5104181-9564-4f75-9400-f64826fcf1fe","Type":"ContainerStarted","Data":"eac65cb22400da3bba6c9cfe5aff65cb2b227d3e94d8fc0fd65ce3b3b5eb7963"}
Jul 17 11:32:20.946160 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:20.946102    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" podStartSLOduration=18.946040621 podStartE2EDuration="18.946040621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:32:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:32:20.945792482 +0000 UTC m=+2381.750817967" watchObservedRunningTime="2026-07-17 11:32:20.946040621 +0000 UTC m=+2381.751066107"
Jul 17 11:32:21.936308 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:21.936275    2562 generic.go:356] "Generic (PLEG): container finished" podID="d5104181-9564-4f75-9400-f64826fcf1fe" containerID="eac65cb22400da3bba6c9cfe5aff65cb2b227d3e94d8fc0fd65ce3b3b5eb7963" exitCode=7
Jul 17 11:32:21.936747 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:21.936330    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" event={"ID":"d5104181-9564-4f75-9400-f64826fcf1fe","Type":"ContainerDied","Data":"eac65cb22400da3bba6c9cfe5aff65cb2b227d3e94d8fc0fd65ce3b3b5eb7963"}
Jul 17 11:32:21.936747 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:21.936379    2562 scope.go:117] "RemoveContainer" containerID="d734f959c35cdcdaa85bab2c9c4a78c158caf1018b53c81be50dc9f9e00be9af"
Jul 17 11:32:21.936747 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:21.936681    2562 scope.go:117] "RemoveContainer" containerID="eac65cb22400da3bba6c9cfe5aff65cb2b227d3e94d8fc0fd65ce3b3b5eb7963"
Jul 17 11:32:21.936884 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:32:21.936864    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-71832244-p4kc8_odh-ai-gateway-infra(d5104181-9564-4f75-9400-f64826fcf1fe)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" podUID="d5104181-9564-4f75-9400-f64826fcf1fe"
Jul 17 11:32:21.962013 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:21.961986    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"]
Jul 17 11:32:23.080520 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.080492    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"
Jul 17 11:32:23.171727 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.171695    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5104181-9564-4f75-9400-f64826fcf1fe-maas-api-service-ca\") pod \"d5104181-9564-4f75-9400-f64826fcf1fe\" (UID: \"d5104181-9564-4f75-9400-f64826fcf1fe\") "
Jul 17 11:32:23.172035 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.172012    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5104181-9564-4f75-9400-f64826fcf1fe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5104181-9564-4f75-9400-f64826fcf1fe" (UID: "d5104181-9564-4f75-9400-f64826fcf1fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:32:23.272487 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.272409    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5104181-9564-4f75-9400-f64826fcf1fe-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:32:23.346515 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.346477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:23.472425 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.472388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:23.948374 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.948294    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"
Jul 17 11:32:23.948515 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.948293    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8" event={"ID":"d5104181-9564-4f75-9400-f64826fcf1fe","Type":"ContainerDied","Data":"13c90d5c3f4a996f0980afaab1fb0c78cdc7dda60124a75d1e334d059bedf78e"}
Jul 17 11:32:23.948515 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.948420    2562 scope.go:117] "RemoveContainer" containerID="eac65cb22400da3bba6c9cfe5aff65cb2b227d3e94d8fc0fd65ce3b3b5eb7963"
Jul 17 11:32:23.964642 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.964618    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"]
Jul 17 11:32:23.970709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:23.970686    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-71832244-p4kc8"]
Jul 17 11:32:25.679751 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:25.679720    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" path="/var/lib/kubelet/pods/d5104181-9564-4f75-9400-f64826fcf1fe/volumes"
Jul 17 11:32:29.335838 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:29.335803    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:30.219728 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:30.219695    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:35.780284 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:35.780246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:35.881765 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:35.881725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:36.291752 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:36.291723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:36.401675 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:36.401640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:36.513256 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:36.513219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:38.137608 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:38.137574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:44.104238 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:44.104199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:44.224007 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:44.223977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:44.304785 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:44.304750    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:44.405062 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:44.405031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:45.070306 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:45.070271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:32:45.169986 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:32:45.169947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:11.066758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:11.066721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:17.101726 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:17.101674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:17.218595 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:17.218554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:17.303398 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:17.303358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:33.348304 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:33.348274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:39.162868 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:39.162835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:39.269962 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:39.269927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:39.365013 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:39.364978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:49.930005 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:49.929967    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:50.781626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:50.781596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:56.827868 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:56.827831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:56.904748 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:56.904713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:57.005829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:57.005796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:57.105821 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:57.105739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:57.206508 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:57.206476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:57.984750 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:57.984715    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:58.098970 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:58.098939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:58.213563 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:58.213529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:33:59.927413 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:33:59.927374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:05.794808 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:05.794770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:05.898274 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:05.898243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:06.547683 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:06.547645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:13.692931 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:13.692895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:13.791148 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:13.791115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:13.959118 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:13.959009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:14.275186 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275111    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"]
Jul 17 11:34:14.275523 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275509    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:34:14.275585 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275526    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:34:14.275585 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275544    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:34:14.275585 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275550    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:34:14.275585 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275566    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:34:14.275585 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275573    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:34:14.275815 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275632    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cedd47f7-1671-4e0c-ad04-e5099e4c73c6" containerName="revoke-keys"
Jul 17 11:34:14.275815 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275641    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:34:14.275815 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.275648    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:34:14.278707 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.278691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.281356 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.281336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ff1f9608-openshift-default-dockercfg-pvs9t\""
Jul 17 11:34:14.299156 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.299123    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"]
Jul 17 11:34:14.310359 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.310327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:14.346822 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.346788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449f12f-e427-4785-88ab-603536e0457c-istio-podinfo\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.346822 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.346824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-certs\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.346995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.346840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-envoy\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.346995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.346924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-credential-socket\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.346995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.346953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvsnq\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-kube-api-access-lvsnq\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.346995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.346976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-socket\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.347153 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.346999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-istio-token\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.347153 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.347068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449f12f-e427-4785-88ab-603536e0457c-istiod-ca-cert\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.347153 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.347121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-data\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.420407 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.420342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:14.447847 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.447820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-credential-socket\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.447851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvsnq\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-kube-api-access-lvsnq\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.447870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-socket\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.447890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-istio-token\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.447941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449f12f-e427-4785-88ab-603536e0457c-istiod-ca-cert\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.447972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-data\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448304 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.448047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449f12f-e427-4785-88ab-603536e0457c-istio-podinfo\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448304 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.448091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-certs\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448304 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.448211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-envoy\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448304 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.448260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-credential-socket\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448482 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.448440    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-socket\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448482 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.448446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-data\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448587 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.448538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-certs\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.448847 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.448812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449f12f-e427-4785-88ab-603536e0457c-istiod-ca-cert\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.450398 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.450369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-envoy\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.450560 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.450545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449f12f-e427-4785-88ab-603536e0457c-istio-podinfo\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.456906 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.456882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvsnq\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-kube-api-access-lvsnq\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.457059 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.457043    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-istio-token\") pod \"e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") " pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.588685 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.588596    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:14.723419 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.723392    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"]
Jul 17 11:34:14.725550 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:34:14.725520    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf449f12f_e427_4785_88ab_603536e0457c.slice/crio-e6032e2f0cb0bc27e7d5ec6cdd0343980fef786e4daee449b7b4c2dceb129f76 WatchSource:0}: Error finding container e6032e2f0cb0bc27e7d5ec6cdd0343980fef786e4daee449b7b4c2dceb129f76: Status 404 returned error can't find the container with id e6032e2f0cb0bc27e7d5ec6cdd0343980fef786e4daee449b7b4c2dceb129f76
Jul 17 11:34:14.727724 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.727683    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:34:14.727840 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.727749    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:34:14.727840 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:14.727779    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:34:15.465674 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:15.465642    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" event={"ID":"f449f12f-e427-4785-88ab-603536e0457c","Type":"ContainerStarted","Data":"8fac18f866cede014586fe23028eabe2046718173e7386a833acdf8dbf430047"}
Jul 17 11:34:15.465866 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:15.465696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" event={"ID":"f449f12f-e427-4785-88ab-603536e0457c","Type":"ContainerStarted","Data":"e6032e2f0cb0bc27e7d5ec6cdd0343980fef786e4daee449b7b4c2dceb129f76"}
Jul 17 11:34:15.525277 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:15.525221    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" podStartSLOduration=1.525206179 podStartE2EDuration="1.525206179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:34:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:34:15.521774341 +0000 UTC m=+2496.326799825" watchObservedRunningTime="2026-07-17 11:34:15.525206179 +0000 UTC m=+2496.330231664"
Jul 17 11:34:15.589642 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:15.589612    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:15.594519 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:15.594496    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:16.470323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:16.470287    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:16.471325 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:16.471307    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:17.537884 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:17.537842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:17.636516 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:17.636484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:17.817958 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:17.817857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:18.410637 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:18.410602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:18.511316 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:18.511288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:18.612056 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:18.612000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:21.201612 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:21.201583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:22.097824 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:22.097794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:22.822259 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:22.822214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:22.922021 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:22.921989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:23.315840 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:23.315795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:29.333323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:29.333289    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:29.436525 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:29.436474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:31.472464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:31.472381    2562 patch_prober.go:28] interesting pod/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 11:34:31.472464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:31.472452    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 11:34:31.546394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:31.546292    2562 generic.go:356] "Generic (PLEG): container finished" podID="f449f12f-e427-4785-88ab-603536e0457c" containerID="8fac18f866cede014586fe23028eabe2046718173e7386a833acdf8dbf430047" exitCode=0
Jul 17 11:34:31.546394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:31.546367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" event={"ID":"f449f12f-e427-4785-88ab-603536e0457c","Type":"ContainerDied","Data":"8fac18f866cede014586fe23028eabe2046718173e7386a833acdf8dbf430047"}
Jul 17 11:34:31.546836 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:31.546819    2562 scope.go:117] "RemoveContainer" containerID="8fac18f866cede014586fe23028eabe2046718173e7386a833acdf8dbf430047"
Jul 17 11:34:31.547818 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:31.547789    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:34:31.547946 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:31.547873    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:34:31.547946 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:31.547922    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:34:32.553050 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:32.553015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" event={"ID":"f449f12f-e427-4785-88ab-603536e0457c","Type":"ContainerStarted","Data":"1a095da7e1f03b640f6b9500ffd2a1ddbce38a29bc359c997a645f39d65f0473"}
Jul 17 11:34:32.588876 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:32.588845    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:32.589107 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:32.589067    2562 patch_prober.go:28] interesting pod/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 11:34:32.589155 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:32.589131    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 11:34:33.589771 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:33.589736    2562 patch_prober.go:28] interesting pod/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 11:34:33.590154 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:33.589792    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 11:34:34.589212 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:34.589172    2562 patch_prober.go:28] interesting pod/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 11:34:34.589432 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:34.589240    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 11:34:35.589324 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:35.589288    2562 patch_prober.go:28] interesting pod/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 17 11:34:35.589710 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:35.589346    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 17 11:34:36.593332 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:36.593299    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:36.593750 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:36.593557    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:36.594284 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:36.594266    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:34:40.506374 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:40.506336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:44.868758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:44.868723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:50.818852 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:50.818813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:50.919384 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:50.919346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:55.564965 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:55.564931    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"]
Jul 17 11:34:55.565492 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:55.565172    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy" containerID="cri-o://1a095da7e1f03b640f6b9500ffd2a1ddbce38a29bc359c997a645f39d65f0473" gracePeriod=30
Jul 17 11:34:55.592717 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:55.592688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:55.841289 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:55.841209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:55.975131 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:55.975095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:56.073217 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:56.073191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:34:56.216025 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:34:56.215998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:00.689364 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.689329    2562 generic.go:356] "Generic (PLEG): container finished" podID="f449f12f-e427-4785-88ab-603536e0457c" containerID="1a095da7e1f03b640f6b9500ffd2a1ddbce38a29bc359c997a645f39d65f0473" exitCode=0
Jul 17 11:35:00.689744 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.689396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" event={"ID":"f449f12f-e427-4785-88ab-603536e0457c","Type":"ContainerDied","Data":"1a095da7e1f03b640f6b9500ffd2a1ddbce38a29bc359c997a645f39d65f0473"}
Jul 17 11:35:00.689744 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.689457    2562 scope.go:117] "RemoveContainer" containerID="8fac18f866cede014586fe23028eabe2046718173e7386a833acdf8dbf430047"
Jul 17 11:35:00.809200 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.809175    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:35:00.878706 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.878680    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvsnq\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-kube-api-access-lvsnq\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.878889 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.878735    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-certs\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.878889 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.878762    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-istio-token\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.878889 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.878881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-credential-socket\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.879062 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.878950    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-data\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.879062 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.878980    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449f12f-e427-4785-88ab-603536e0457c-istio-podinfo\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.879062 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879016    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-envoy\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.879062 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879046    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-socket\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.879302 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879110    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449f12f-e427-4785-88ab-603536e0457c-istiod-ca-cert\") pod \"f449f12f-e427-4785-88ab-603536e0457c\" (UID: \"f449f12f-e427-4785-88ab-603536e0457c\") "
Jul 17 11:35:00.879302 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879119    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:35:00.879302 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879156    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:35:00.879448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879373    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:35:00.879506 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879438    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f449f12f-e427-4785-88ab-603536e0457c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:35:00.879566 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879514    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f449f12f-e427-4785-88ab-603536e0457c-istiod-ca-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:00.879566 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879530    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:00.879566 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879539    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-credential-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:00.879566 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879548    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-workload-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:00.879888 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.879855    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-data" (OuterVolumeSpecName: "istio-data") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:35:00.881006 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.880983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-istio-token" (OuterVolumeSpecName: "istio-token") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:35:00.881306 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.881276    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:35:00.881584 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.881565    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f449f12f-e427-4785-88ab-603536e0457c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 11:35:00.881630 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.881568    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-kube-api-access-lvsnq" (OuterVolumeSpecName: "kube-api-access-lvsnq") pod "f449f12f-e427-4785-88ab-603536e0457c" (UID: "f449f12f-e427-4785-88ab-603536e0457c"). InnerVolumeSpecName "kube-api-access-lvsnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:35:00.980530 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.980496    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvsnq\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-kube-api-access-lvsnq\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:00.980530 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.980526    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f449f12f-e427-4785-88ab-603536e0457c-istio-token\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:00.980530 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.980536    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-data\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:00.980754 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.980545    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f449f12f-e427-4785-88ab-603536e0457c-istio-podinfo\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:00.980754 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:00.980555    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f449f12f-e427-4785-88ab-603536e0457c-istio-envoy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:35:01.695716 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:01.695693    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"
Jul 17 11:35:01.696052 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:01.695716    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn" event={"ID":"f449f12f-e427-4785-88ab-603536e0457c","Type":"ContainerDied","Data":"e6032e2f0cb0bc27e7d5ec6cdd0343980fef786e4daee449b7b4c2dceb129f76"}
Jul 17 11:35:01.696052 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:01.695778    2562 scope.go:117] "RemoveContainer" containerID="1a095da7e1f03b640f6b9500ffd2a1ddbce38a29bc359c997a645f39d65f0473"
Jul 17 11:35:01.714264 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:01.714237    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"]
Jul 17 11:35:01.720444 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:01.720420    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ff1f9608-openshift-default-66fd8f896c-st2cn"]
Jul 17 11:35:01.943404 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:01.943322    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:02.061970 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:02.061929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:02.151476 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:02.151447    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:02.326611 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:02.326529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:03.680294 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:03.680261    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f449f12f-e427-4785-88ab-603536e0457c" path="/var/lib/kubelet/pods/f449f12f-e427-4785-88ab-603536e0457c/volumes"
Jul 17 11:35:08.418717 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:08.418681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:08.521494 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:08.521462    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:15.259264 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.259212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:15.552739 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.552661    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"]
Jul 17 11:35:15.553055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.553042    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy"
Jul 17 11:35:15.553115 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.553057    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy"
Jul 17 11:35:15.553115 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.553104    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:35:15.553115 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.553111    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:35:15.553215 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.553193    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5104181-9564-4f75-9400-f64826fcf1fe" containerName="revoke-keys"
Jul 17 11:35:15.553215 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.553202    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy"
Jul 17 11:35:15.553215 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.553208    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy"
Jul 17 11:35:15.555143 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.555126    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.560678 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.560645    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-caf75d03-openshift-default-dockercfg-h6mhl\""
Jul 17 11:35:15.579148 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.579120    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"]
Jul 17 11:35:15.592610 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.592573    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:15.616787 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.616758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-data\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.616927 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.616791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-credential-socket\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.616927 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.616818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-socket\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.617017 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.616932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-token\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.617017 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.616999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-certs\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.617115 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.617040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-podinfo\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.617115 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.617065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istiod-ca-cert\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.617188 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.617116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-envoy\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.617223 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.617186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq94r\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-kube-api-access-bq94r\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.717652 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.717620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-token\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.717827 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.717672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-certs\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.717827 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.717707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-podinfo\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.717827 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.717724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istiod-ca-cert\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.717827 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.717743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-envoy\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.717827 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.717785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq94r\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-kube-api-access-bq94r\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.718185 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.717909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-data\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.718185 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.717967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-credential-socket\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.718185 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.718026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-socket\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.718355 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.718243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-certs\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.718355 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.718283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-data\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.718471 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.718347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-credential-socket\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.718471 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.718439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-socket\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.718671 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.718653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istiod-ca-cert\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.720176 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.720153    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-envoy\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.720271 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.720251    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-podinfo\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.739729 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.739705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-token\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.748905 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.748881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq94r\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-kube-api-access-bq94r\") pod \"e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") " pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.865669 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.865636    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:15.937481 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:15.937449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:16.027097 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:16.027041    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"]
Jul 17 11:35:16.031932 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:35:16.031904    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9221a23_6a54_46c7_89e7_ccb7c9f68ac6.slice/crio-a65e23ec4dbb8f3dadfa2e7322bb98e9fdc6c67dcd0a6df168c1c65c0ed68942 WatchSource:0}: Error finding container a65e23ec4dbb8f3dadfa2e7322bb98e9fdc6c67dcd0a6df168c1c65c0ed68942: Status 404 returned error can't find the container with id a65e23ec4dbb8f3dadfa2e7322bb98e9fdc6c67dcd0a6df168c1c65c0ed68942
Jul 17 11:35:16.034070 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:16.034030    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:35:16.034177 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:16.034128    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:35:16.034177 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:16.034162    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:35:16.771036 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:16.770992    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" event={"ID":"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6","Type":"ContainerStarted","Data":"4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f"}
Jul 17 11:35:16.771451 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:16.771059    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" event={"ID":"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6","Type":"ContainerStarted","Data":"a65e23ec4dbb8f3dadfa2e7322bb98e9fdc6c67dcd0a6df168c1c65c0ed68942"}
Jul 17 11:35:16.794462 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:16.794407    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" podStartSLOduration=1.79438488 podStartE2EDuration="1.79438488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:35:16.792577151 +0000 UTC m=+2557.597602626" watchObservedRunningTime="2026-07-17 11:35:16.79438488 +0000 UTC m=+2557.599410364"
Jul 17 11:35:16.866760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:16.866723    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:17.871299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:17.871262    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:18.728307 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:18.728270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:18.780799 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:18.780770    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:18.781803 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:18.781782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:18.834402 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:18.834360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:18.925169 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:18.925124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:19.116712 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:19.116682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:19.521701 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:19.521621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:19.623245 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:19.623214    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:23.195919 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:23.195882    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:24.654450 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.654416    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"]
Jul 17 11:35:24.654818 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.654795    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy"
Jul 17 11:35:24.654818 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.654806    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f449f12f-e427-4785-88ab-603536e0457c" containerName="istio-proxy"
Jul 17 11:35:24.657835 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.657819    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.661375 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.661353    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-caf75d03\"/\"kube-root-ca.crt\""
Jul 17 11:35:24.661522 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.661400    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-caf75d03\"/\"default-dockercfg-kw4lk\""
Jul 17 11:35:24.661522 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.661406    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-caf75d03\"/\"e2e-lifecycle-model-caf75d03-kserve-self-signed-certs\""
Jul 17 11:35:24.661522 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.661418    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-caf75d03\"/\"openshift-service-ca.crt\""
Jul 17 11:35:24.666375 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.666356    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"]
Jul 17 11:35:24.743945 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.743911    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:24.796005 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.795971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tmp-dir\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.796168 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.796030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tls-certs\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.796168 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.796066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-dshm\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.796168 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.796145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-model-cache\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.796168 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.796164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-home\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.796326 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.796235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmg25\" (UniqueName: \"kubernetes.io/projected/766ac893-69c1-46a4-bc8d-6e5035d3ad88-kube-api-access-lmg25\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.897517 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.897484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tls-certs\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.897517 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.897516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-dshm\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.897718 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.897561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-model-cache\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.897718 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.897579    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-home\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.897718 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.897605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmg25\" (UniqueName: \"kubernetes.io/projected/766ac893-69c1-46a4-bc8d-6e5035d3ad88-kube-api-access-lmg25\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.897718 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.897640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tmp-dir\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.898036 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.898016    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-model-cache\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.898133 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.898054    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-home\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.898133 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.898115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tmp-dir\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.899852 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.899830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-dshm\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.900040 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.900023    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tls-certs\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.905537 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.905477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmg25\" (UniqueName: \"kubernetes.io/projected/766ac893-69c1-46a4-bc8d-6e5035d3ad88-kube-api-access-lmg25\") pod \"e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") " pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:24.968554 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:24.968519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:25.105210 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:25.105185    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"]
Jul 17 11:35:25.107140 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:35:25.107112    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod766ac893_69c1_46a4_bc8d_6e5035d3ad88.slice/crio-c7d22bf290377a7411b98afaaa72f28fb6272bc4a2df508b6d456d11f8f4c690 WatchSource:0}: Error finding container c7d22bf290377a7411b98afaaa72f28fb6272bc4a2df508b6d456d11f8f4c690: Status 404 returned error can't find the container with id c7d22bf290377a7411b98afaaa72f28fb6272bc4a2df508b6d456d11f8f4c690
Jul 17 11:35:25.818314 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:25.818272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789" event={"ID":"766ac893-69c1-46a4-bc8d-6e5035d3ad88","Type":"ContainerStarted","Data":"275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1"}
Jul 17 11:35:25.818314 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:25.818316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789" event={"ID":"766ac893-69c1-46a4-bc8d-6e5035d3ad88","Type":"ContainerStarted","Data":"c7d22bf290377a7411b98afaaa72f28fb6272bc4a2df508b6d456d11f8f4c690"}
Jul 17 11:35:25.836966 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:25.836916    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789" podStartSLOduration=1.8369008519999999 podStartE2EDuration="1.836900852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:35:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:35:25.835644742 +0000 UTC m=+2566.640670224" watchObservedRunningTime="2026-07-17 11:35:25.836900852 +0000 UTC m=+2566.641926387"
Jul 17 11:35:32.871088 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:32.871046    2562 generic.go:356] "Generic (PLEG): container finished" podID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerID="4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f" exitCode=0
Jul 17 11:35:32.871473 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:32.871118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" event={"ID":"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6","Type":"ContainerDied","Data":"4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f"}
Jul 17 11:35:32.871545 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:32.871531    2562 scope.go:117] "RemoveContainer" containerID="4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f"
Jul 17 11:35:32.872589 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:32.872564    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:35:32.872642 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:32.872631    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:35:32.872682 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:32.872661    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:35:33.781465 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:33.781424    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:33.884337 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:33.884295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" event={"ID":"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6","Type":"ContainerStarted","Data":"2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202"}
Jul 17 11:35:34.866364 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:34.866324    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:34.867544 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:34.867521    2562 patch_prober.go:28] interesting pod/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 17 11:35:34.867602 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:34.867582    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 17 11:35:34.969213 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:34.969171    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:34.969663 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:34.969271    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:34.981937 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:34.981916    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:35.866944 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:35.866903    2562 patch_prober.go:28] interesting pod/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 17 11:35:35.867150 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:35.866963    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 17 11:35:35.905872 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:35.905844    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:35:36.866637 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:36.866596    2562 patch_prober.go:28] interesting pod/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Jul 17 11:35:36.867034 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:36.866697    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Jul 17 11:35:37.871033 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:37.871001    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:37.871456 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:37.871298    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:37.872100 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:37.872065    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:35:53.963863 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:53.963825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:35:56.633953 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:35:56.633893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:01.243035 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:01.242951    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:06.223255 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:06.223218    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"]
Jul 17 11:36:06.316362 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:06.316334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:07.733250 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:07.733198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:21.243401 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.243359    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789" podUID="766ac893-69c1-46a4-bc8d-6e5035d3ad88" containerName="main" containerID="cri-o://275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1" gracePeriod=45
Jul 17 11:36:21.496122 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.496053    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:36:21.553808 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.553775    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmg25\" (UniqueName: \"kubernetes.io/projected/766ac893-69c1-46a4-bc8d-6e5035d3ad88-kube-api-access-lmg25\") pod \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") "
Jul 17 11:36:21.553976 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.553886    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-dshm\") pod \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") "
Jul 17 11:36:21.553976 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.553943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tls-certs\") pod \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") "
Jul 17 11:36:21.554114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.553982    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tmp-dir\") pod \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") "
Jul 17 11:36:21.554114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.554010    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-model-cache\") pod \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") "
Jul 17 11:36:21.554114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.554061    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-home\") pod \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\" (UID: \"766ac893-69c1-46a4-bc8d-6e5035d3ad88\") "
Jul 17 11:36:21.554433 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.554389    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-model-cache" (OuterVolumeSpecName: "model-cache") pod "766ac893-69c1-46a4-bc8d-6e5035d3ad88" (UID: "766ac893-69c1-46a4-bc8d-6e5035d3ad88"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:21.554433 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.554407    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "766ac893-69c1-46a4-bc8d-6e5035d3ad88" (UID: "766ac893-69c1-46a4-bc8d-6e5035d3ad88"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:21.554658 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.554631    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-home" (OuterVolumeSpecName: "home") pod "766ac893-69c1-46a4-bc8d-6e5035d3ad88" (UID: "766ac893-69c1-46a4-bc8d-6e5035d3ad88"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:21.556247 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.556225    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-dshm" (OuterVolumeSpecName: "dshm") pod "766ac893-69c1-46a4-bc8d-6e5035d3ad88" (UID: "766ac893-69c1-46a4-bc8d-6e5035d3ad88"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:21.556247 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.556230    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766ac893-69c1-46a4-bc8d-6e5035d3ad88-kube-api-access-lmg25" (OuterVolumeSpecName: "kube-api-access-lmg25") pod "766ac893-69c1-46a4-bc8d-6e5035d3ad88" (UID: "766ac893-69c1-46a4-bc8d-6e5035d3ad88"). InnerVolumeSpecName "kube-api-access-lmg25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:36:21.556534 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.556516    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "766ac893-69c1-46a4-bc8d-6e5035d3ad88" (UID: "766ac893-69c1-46a4-bc8d-6e5035d3ad88"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:36:21.655103 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.655044    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmg25\" (UniqueName: \"kubernetes.io/projected/766ac893-69c1-46a4-bc8d-6e5035d3ad88-kube-api-access-lmg25\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:21.655103 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.655099    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:21.655315 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.655115    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:21.655315 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.655129    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:21.655315 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.655140    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:21.655315 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:21.655151    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/766ac893-69c1-46a4-bc8d-6e5035d3ad88-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:22.113925 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.113887    2562 generic.go:356] "Generic (PLEG): container finished" podID="766ac893-69c1-46a4-bc8d-6e5035d3ad88" containerID="275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1" exitCode=0
Jul 17 11:36:22.114147 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.113943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789" event={"ID":"766ac893-69c1-46a4-bc8d-6e5035d3ad88","Type":"ContainerDied","Data":"275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1"}
Jul 17 11:36:22.114147 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.113972    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789" event={"ID":"766ac893-69c1-46a4-bc8d-6e5035d3ad88","Type":"ContainerDied","Data":"c7d22bf290377a7411b98afaaa72f28fb6272bc4a2df508b6d456d11f8f4c690"}
Jul 17 11:36:22.114147 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.113990    2562 scope.go:117] "RemoveContainer" containerID="275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1"
Jul 17 11:36:22.114147 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.113946    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"
Jul 17 11:36:22.122548 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.122527    2562 scope.go:117] "RemoveContainer" containerID="275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1"
Jul 17 11:36:22.122865 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:36:22.122842    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1\": container with ID starting with 275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1 not found: ID does not exist" containerID="275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1"
Jul 17 11:36:22.122916 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.122874    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1"} err="failed to get container status \"275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1\": rpc error: code = NotFound desc = could not find container \"275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1\": container with ID starting with 275e742f8d1dc16d1ac4b19ebcd6a0a1051934bedb0b3a92ba0570789cd084f1 not found: ID does not exist"
Jul 17 11:36:22.133626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.133596    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"]
Jul 17 11:36:22.137716 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:22.137694    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-caf75d03/e2e-lifecycle-model-caf75d03-kserve-6747fcf455-zs789"]
Jul 17 11:36:23.680748 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:23.680717    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="766ac893-69c1-46a4-bc8d-6e5035d3ad88" path="/var/lib/kubelet/pods/766ac893-69c1-46a4-bc8d-6e5035d3ad88/volumes"
Jul 17 11:36:42.472803 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:42.472772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:43.508683 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:43.508648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:49.276500 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:49.276467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:49.377920 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:49.377878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:53.569636 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:53.569601    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"]
Jul 17 11:36:53.570012 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:53.569831    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy" containerID="cri-o://2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202" gracePeriod=30
Jul 17 11:36:53.585995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:53.585968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:53.824600 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:53.824521    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:54.896514 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:54.896480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:54.981354 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:54.981317    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:55.092185 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:55.092156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:55.843808 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:55.843775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:55.941719 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:55.941680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:56.046895 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:56.046852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:57.470952 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:57.470916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:36:58.832378 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.832355    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:36:58.903363 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903334    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-token\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903536 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903400    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-credential-socket\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903536 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903434    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-data\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903536 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903470    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-certs\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903536 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istiod-ca-cert\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903536 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903534    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-envoy\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903573    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-podinfo\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903602    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-socket\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903643    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq94r\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-kube-api-access-bq94r\") pod \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\" (UID: \"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6\") "
Jul 17 11:36:58.903830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903802    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:58.903830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903819    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:58.904114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.903858    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:36:58.904114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.904000    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-credential-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:58.904114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.904015    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:58.904114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.904025    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istiod-ca-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:58.904114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.904041    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:58.904373 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.904347    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:58.905973 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.905942    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:36:58.906286 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.906262    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-kube-api-access-bq94r" (OuterVolumeSpecName: "kube-api-access-bq94r") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "kube-api-access-bq94r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:36:58.906420 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.906335    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:36:58.906486 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:58.906455    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" (UID: "a9221a23-6a54-46c7-89e7-ccb7c9f68ac6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 11:36:59.004976 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.004942    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-data\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:59.004976 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.004970    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-envoy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:59.004976 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.004978    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-podinfo\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:59.005248 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.004989    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-workload-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:59.005248 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.004998    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq94r\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-kube-api-access-bq94r\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:59.005248 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.005007    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6-istio-token\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:36:59.296032 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.295936    2562 generic.go:356] "Generic (PLEG): container finished" podID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerID="2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202" exitCode=0
Jul 17 11:36:59.296288 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.296017    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"
Jul 17 11:36:59.296464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.296021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" event={"ID":"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6","Type":"ContainerDied","Data":"2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202"}
Jul 17 11:36:59.296565 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.296548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb" event={"ID":"a9221a23-6a54-46c7-89e7-ccb7c9f68ac6","Type":"ContainerDied","Data":"a65e23ec4dbb8f3dadfa2e7322bb98e9fdc6c67dcd0a6df168c1c65c0ed68942"}
Jul 17 11:36:59.296620 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.296587    2562 scope.go:117] "RemoveContainer" containerID="2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202"
Jul 17 11:36:59.309404 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.309332    2562 scope.go:117] "RemoveContainer" containerID="4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f"
Jul 17 11:36:59.323525 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.323503    2562 scope.go:117] "RemoveContainer" containerID="2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202"
Jul 17 11:36:59.323842 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:36:59.323818    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202\": container with ID starting with 2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202 not found: ID does not exist" containerID="2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202"
Jul 17 11:36:59.323940 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.323853    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202"} err="failed to get container status \"2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202\": rpc error: code = NotFound desc = could not find container \"2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202\": container with ID starting with 2dbe054075a24be14e055842b05459788ede5dae16f5cd8644b713274a2e4202 not found: ID does not exist"
Jul 17 11:36:59.323940 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.323879    2562 scope.go:117] "RemoveContainer" containerID="4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f"
Jul 17 11:36:59.324202 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:36:59.324186    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f\": container with ID starting with 4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f not found: ID does not exist" containerID="4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f"
Jul 17 11:36:59.324262 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.324211    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f"} err="failed to get container status \"4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f\": rpc error: code = NotFound desc = could not find container \"4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f\": container with ID starting with 4805806d4fc178a41cadcd508ea388b4cf850643eb149b16ad6ac8886010533f not found: ID does not exist"
Jul 17 11:36:59.331139 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.331115    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"]
Jul 17 11:36:59.339060 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.339034    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-caf75d03-openshift-default-7bcb4777c9-vrtvb"]
Jul 17 11:36:59.681275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:36:59.681241    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" path="/var/lib/kubelet/pods/a9221a23-6a54-46c7-89e7-ccb7c9f68ac6/volumes"
Jul 17 11:37:03.600851 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:03.600816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:03.683541 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:03.683516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:04.306247 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:04.306210    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:04.474570 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:04.474534    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:04.574324 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:04.574238    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:10.310211 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:10.310181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:11.768564 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:11.768530    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:21.084338 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:21.084305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:21.445943 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:21.445906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:42.448762 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:42.448724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:48.439272 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:48.439236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:48.508677 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:48.508633    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:48.848995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:48.848918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:49.138772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:49.138740    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:49.598548 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:49.598471    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:51.987044 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:51.987008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:52.085577 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:52.085541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:52.267120 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:52.267028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:52.577328 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:52.577246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:52.972890 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:52.972855    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:53.074493 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:53.074463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:56.478402 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:56.478365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:56.821718 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:56.821631    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:57.108832 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.108800    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"]
Jul 17 11:37:57.109291 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109271    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy"
Jul 17 11:37:57.109399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109292    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy"
Jul 17 11:37:57.109399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109313    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy"
Jul 17 11:37:57.109399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109322    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy"
Jul 17 11:37:57.109399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109336    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="766ac893-69c1-46a4-bc8d-6e5035d3ad88" containerName="main"
Jul 17 11:37:57.109399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109344    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="766ac893-69c1-46a4-bc8d-6e5035d3ad88" containerName="main"
Jul 17 11:37:57.109649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109443    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy"
Jul 17 11:37:57.109649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109455    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="766ac893-69c1-46a4-bc8d-6e5035d3ad88" containerName="main"
Jul 17 11:37:57.109649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.109465    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9221a23-6a54-46c7-89e7-ccb7c9f68ac6" containerName="istio-proxy"
Jul 17 11:37:57.112727 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.112706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.115923 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.115903    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b18220-openshift-default-dockercfg-nxf57\""
Jul 17 11:37:57.126630 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.126606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"]
Jul 17 11:37:57.157409 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.157380    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:57.237298 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-data\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.237472 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-certs\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.237472 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-istio-token\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.237472 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237352    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5074efd-985e-48e9-a680-41d914f1e053-istiod-ca-cert\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.237472 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5074efd-985e-48e9-a680-41d914f1e053-istio-podinfo\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.237472 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-credential-socket\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.237472 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-envoy\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.237675 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-socket\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.237675 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.237560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t856l\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-kube-api-access-t856l\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.338758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-credential-socket\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.338758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-envoy\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339007 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-socket\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339007 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t856l\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-kube-api-access-t856l\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339007 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-data\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339007 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-certs\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339007 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-istio-token\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339007 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5074efd-985e-48e9-a680-41d914f1e053-istiod-ca-cert\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339007 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.338927    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5074efd-985e-48e9-a680-41d914f1e053-istio-podinfo\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.339294    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-credential-socket\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.339328    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-socket\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.339364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-data\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.339388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-certs\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.339939 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.339915    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5074efd-985e-48e9-a680-41d914f1e053-istiod-ca-cert\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.341056 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.341037    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-envoy\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.341400 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.341379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5074efd-985e-48e9-a680-41d914f1e053-istio-podinfo\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.348579 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.348559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-istio-token\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.348824 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.348803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t856l\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-kube-api-access-t856l\") pod \"e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") " pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.423336 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.423256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:57.510277 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.510247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:37:57.565412 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.565385    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"]
Jul 17 11:37:57.568109 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:37:57.568064    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5074efd_985e_48e9_a680_41d914f1e053.slice/crio-8c01215bd79235a0911a83bbe8e1d0de1472d58cf723a230b1759cc2b799f325 WatchSource:0}: Error finding container 8c01215bd79235a0911a83bbe8e1d0de1472d58cf723a230b1759cc2b799f325: Status 404 returned error can't find the container with id 8c01215bd79235a0911a83bbe8e1d0de1472d58cf723a230b1759cc2b799f325
Jul 17 11:37:57.570214 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.570169    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:37:57.570292 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.570262    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:37:57.570334 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:57.570304    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:37:58.570499 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:58.570466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" event={"ID":"c5074efd-985e-48e9-a680-41d914f1e053","Type":"ContainerStarted","Data":"ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926"}
Jul 17 11:37:58.570888 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:58.570515    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" event={"ID":"c5074efd-985e-48e9-a680-41d914f1e053","Type":"ContainerStarted","Data":"8c01215bd79235a0911a83bbe8e1d0de1472d58cf723a230b1759cc2b799f325"}
Jul 17 11:37:58.592778 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:58.592725    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" podStartSLOduration=1.5927097460000001 podStartE2EDuration="1.592709746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:37:58.592265122 +0000 UTC m=+2719.397290677" watchObservedRunningTime="2026-07-17 11:37:58.592709746 +0000 UTC m=+2719.397735230"
Jul 17 11:37:59.424458 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:59.424420    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:59.429583 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:59.429555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:59.574895 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:59.574852    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:37:59.576091 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:37:59.576049    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:38:00.542790 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:00.542759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:00.632674 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:00.632640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:00.826396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:00.826291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:01.313313 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:01.313278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:01.418462 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:01.418433    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:01.515555 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:01.515517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:05.051770 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:05.051723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:11.899422 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.899385    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"]
Jul 17 11:38:11.903165 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.903146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:11.912070 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.912043    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4da7d6\"/\"kube-root-ca.crt\""
Jul 17 11:38:11.912238 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.912070    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4da7d6\"/\"default-dockercfg-k8m2p\""
Jul 17 11:38:11.912238 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.912161    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4da7d6\"/\"test-model-4da7d6-kserve-self-signed-certs\""
Jul 17 11:38:11.912238 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.912070    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4da7d6\"/\"openshift-service-ca.crt\""
Jul 17 11:38:11.923105 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.923063    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"]
Jul 17 11:38:11.929131 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.929101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:11.974685 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.974652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-model-cache\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:11.974864 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.974719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-home\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:11.974864 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.974743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f53091-dd63-4e75-b222-c313f4778015-tls-certs\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:11.974864 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.974788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k2f7\" (UniqueName: \"kubernetes.io/projected/c8f53091-dd63-4e75-b222-c313f4778015-kube-api-access-5k2f7\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:11.974864 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.974856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-dshm\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:11.975022 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:11.974885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-tmp-dir\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.075760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.075719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-model-cache\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.075969 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.075780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-home\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.075969 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.075801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f53091-dd63-4e75-b222-c313f4778015-tls-certs\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.075969 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.075840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k2f7\" (UniqueName: \"kubernetes.io/projected/c8f53091-dd63-4e75-b222-c313f4778015-kube-api-access-5k2f7\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.075969 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.075882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-dshm\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.075969 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.075901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-tmp-dir\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.076269 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.076246    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-home\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.076336 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.076276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-model-cache\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.076606 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.076582    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-tmp-dir\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.078313 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.078287    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-dshm\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.078561 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.078542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f53091-dd63-4e75-b222-c313f4778015-tls-certs\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.085383 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.085360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k2f7\" (UniqueName: \"kubernetes.io/projected/c8f53091-dd63-4e75-b222-c313f4778015-kube-api-access-5k2f7\") pod \"test-model-4da7d6-kserve-5b5567c48f-k9mth\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") " pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.213852 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.213763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:12.361948 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.361918    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"]
Jul 17 11:38:12.364115 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:38:12.364052    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8f53091_dd63_4e75_b222_c313f4778015.slice/crio-fa24ffd644fe774032289fd25fa19c4c089a3efcc26f7b4ef7e8afd8db87af83 WatchSource:0}: Error finding container fa24ffd644fe774032289fd25fa19c4c089a3efcc26f7b4ef7e8afd8db87af83: Status 404 returned error can't find the container with id fa24ffd644fe774032289fd25fa19c4c089a3efcc26f7b4ef7e8afd8db87af83
Jul 17 11:38:12.645518 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.645479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth" event={"ID":"c8f53091-dd63-4e75-b222-c313f4778015","Type":"ContainerStarted","Data":"0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94"}
Jul 17 11:38:12.645694 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.645532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth" event={"ID":"c8f53091-dd63-4e75-b222-c313f4778015","Type":"ContainerStarted","Data":"fa24ffd644fe774032289fd25fa19c4c089a3efcc26f7b4ef7e8afd8db87af83"}
Jul 17 11:38:12.664047 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:12.664001    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth" podStartSLOduration=1.663985396 podStartE2EDuration="1.663985396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:38:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:38:12.662692028 +0000 UTC m=+2733.467717528" watchObservedRunningTime="2026-07-17 11:38:12.663985396 +0000 UTC m=+2733.469010934"
Jul 17 11:38:13.833761 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:13.833682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:13.934140 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:13.934046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:14.576378 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:14.576345    2562 patch_prober.go:28] interesting pod/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 11:38:14.576552 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:14.576397    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 11:38:14.657720 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:14.657687    2562 generic.go:356] "Generic (PLEG): container finished" podID="c5074efd-985e-48e9-a680-41d914f1e053" containerID="ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926" exitCode=0
Jul 17 11:38:14.657894 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:14.657724    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" event={"ID":"c5074efd-985e-48e9-a680-41d914f1e053","Type":"ContainerDied","Data":"ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926"}
Jul 17 11:38:14.658137 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:14.658121    2562 scope.go:117] "RemoveContainer" containerID="ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926"
Jul 17 11:38:14.659192 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:14.659158    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:38:14.659300 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:14.659232    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:38:14.659300 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:14.659269    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:38:15.663970 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:15.663936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" event={"ID":"c5074efd-985e-48e9-a680-41d914f1e053","Type":"ContainerStarted","Data":"72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534"}
Jul 17 11:38:16.424406 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:16.424316    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:38:16.424627 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:16.424604    2562 patch_prober.go:28] interesting pod/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 11:38:16.424708 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:16.424672    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 11:38:17.423991 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:17.423945    2562 patch_prober.go:28] interesting pod/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 11:38:17.424498 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:17.424020    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 11:38:18.423805 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:18.423767    2562 patch_prober.go:28] interesting pod/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 11:38:18.424127 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:18.424094    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 11:38:19.424277 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:19.424228    2562 patch_prober.go:28] interesting pod/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 17 11:38:19.424776 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:19.424314    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 17 11:38:20.427893 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:20.427865    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:38:20.428369 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:20.428244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:38:20.428925 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:20.428909    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:38:22.214200 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:22.214153    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:22.214200 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:22.214204    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:22.233146 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:22.233117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:22.292700 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:22.292659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:22.389132 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:22.389097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:22.706726 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:22.706694    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:38:48.801910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:48.801872    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:49.461680 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.461648    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"]
Jul 17 11:38:49.465199 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.465174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.467879 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.467860    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b18220\"/\"kube-root-ca.crt\""
Jul 17 11:38:49.468831 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.468797    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b18220\"/\"default-dockercfg-7zfrr\""
Jul 17 11:38:49.468831 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.468826    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-b18220\"/\"openshift-service-ca.crt\""
Jul 17 11:38:49.469008 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.468857    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-b18220\"/\"test-model-b18220-kserve-self-signed-certs\""
Jul 17 11:38:49.473997 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.473974    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"]
Jul 17 11:38:49.495090 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.495043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:38:49.541761 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.541728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-model-cache\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.541761 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.541767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tmp-dir\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.542017 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.541927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lht5m\" (UniqueName: \"kubernetes.io/projected/191dc5ad-1f77-4d30-ad20-51bffe349d0c-kube-api-access-lht5m\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.542017 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.541993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-home\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.542183 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.542042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-dshm\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.542183 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.542065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tls-certs\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.642903 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.642869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tls-certs\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.643065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.642917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-model-cache\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.643065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.642937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tmp-dir\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.643065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.643002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lht5m\" (UniqueName: \"kubernetes.io/projected/191dc5ad-1f77-4d30-ad20-51bffe349d0c-kube-api-access-lht5m\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.643065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.643045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-home\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.643319 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.643114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-dshm\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.643372 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.643353    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-model-cache\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.643420 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.643384    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tmp-dir\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.643461 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.643451    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-home\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.645402 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.645380    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-dshm\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.645683 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.645662    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tls-certs\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.652462 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.652437    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lht5m\" (UniqueName: \"kubernetes.io/projected/191dc5ad-1f77-4d30-ad20-51bffe349d0c-kube-api-access-lht5m\") pod \"test-model-b18220-kserve-858779b5c9-tgr8p\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") " pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.776118 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.776009    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:49.907663 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:49.907638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"]
Jul 17 11:38:49.909659 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:38:49.909628    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod191dc5ad_1f77_4d30_ad20_51bffe349d0c.slice/crio-82da5409d6e0881c9a1ee2623c69b757b0a0fae31ecdc22573bca8a9ea414e71 WatchSource:0}: Error finding container 82da5409d6e0881c9a1ee2623c69b757b0a0fae31ecdc22573bca8a9ea414e71: Status 404 returned error can't find the container with id 82da5409d6e0881c9a1ee2623c69b757b0a0fae31ecdc22573bca8a9ea414e71
Jul 17 11:38:50.831349 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:50.831306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p" event={"ID":"191dc5ad-1f77-4d30-ad20-51bffe349d0c","Type":"ContainerStarted","Data":"d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c"}
Jul 17 11:38:50.831531 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:50.831358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p" event={"ID":"191dc5ad-1f77-4d30-ad20-51bffe349d0c","Type":"ContainerStarted","Data":"82da5409d6e0881c9a1ee2623c69b757b0a0fae31ecdc22573bca8a9ea414e71"}
Jul 17 11:38:50.849891 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:50.849842    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p" podStartSLOduration=1.849826985 podStartE2EDuration="1.849826985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:38:50.848053163 +0000 UTC m=+2771.653078649" watchObservedRunningTime="2026-07-17 11:38:50.849826985 +0000 UTC m=+2771.654852480"
Jul 17 11:38:59.777055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:59.777015    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:59.777603 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:59.777278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:59.789653 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:59.789630    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:38:59.884793 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:38:59.884764    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:39:14.597260 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:14.597182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:24.165179 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:24.165141    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"]
Jul 17 11:39:24.198642 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:24.198613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:25.150946 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:25.150910    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"]
Jul 17 11:39:25.175292 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:25.175259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:25.897505 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:25.897473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:26.005308 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:26.005278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:35.994861 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:35.994829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:39.186590 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.186520    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth" podUID="c8f53091-dd63-4e75-b222-c313f4778015" containerName="main" containerID="cri-o://0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94" gracePeriod=45
Jul 17 11:39:39.436173 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.436148    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:39:39.524675 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.524594    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-model-cache\") pod \"c8f53091-dd63-4e75-b222-c313f4778015\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") "
Jul 17 11:39:39.524675 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.524652    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-home\") pod \"c8f53091-dd63-4e75-b222-c313f4778015\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") "
Jul 17 11:39:39.524911 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.524697    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5k2f7\" (UniqueName: \"kubernetes.io/projected/c8f53091-dd63-4e75-b222-c313f4778015-kube-api-access-5k2f7\") pod \"c8f53091-dd63-4e75-b222-c313f4778015\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") "
Jul 17 11:39:39.524911 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.524717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-tmp-dir\") pod \"c8f53091-dd63-4e75-b222-c313f4778015\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") "
Jul 17 11:39:39.524911 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.524788    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-dshm\") pod \"c8f53091-dd63-4e75-b222-c313f4778015\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") "
Jul 17 11:39:39.524911 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.524815    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f53091-dd63-4e75-b222-c313f4778015-tls-certs\") pod \"c8f53091-dd63-4e75-b222-c313f4778015\" (UID: \"c8f53091-dd63-4e75-b222-c313f4778015\") "
Jul 17 11:39:39.524911 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.524865    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-model-cache" (OuterVolumeSpecName: "model-cache") pod "c8f53091-dd63-4e75-b222-c313f4778015" (UID: "c8f53091-dd63-4e75-b222-c313f4778015"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:39:39.525201 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.524955    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-home" (OuterVolumeSpecName: "home") pod "c8f53091-dd63-4e75-b222-c313f4778015" (UID: "c8f53091-dd63-4e75-b222-c313f4778015"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:39:39.525201 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.525029    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c8f53091-dd63-4e75-b222-c313f4778015" (UID: "c8f53091-dd63-4e75-b222-c313f4778015"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:39:39.525201 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.525176    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:39.525201 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.525195    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:39.525453 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.525216    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:39.527048 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.527022    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-dshm" (OuterVolumeSpecName: "dshm") pod "c8f53091-dd63-4e75-b222-c313f4778015" (UID: "c8f53091-dd63-4e75-b222-c313f4778015"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:39:39.527048 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.527030    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8f53091-dd63-4e75-b222-c313f4778015-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c8f53091-dd63-4e75-b222-c313f4778015" (UID: "c8f53091-dd63-4e75-b222-c313f4778015"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:39:39.527207 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.527054    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8f53091-dd63-4e75-b222-c313f4778015-kube-api-access-5k2f7" (OuterVolumeSpecName: "kube-api-access-5k2f7") pod "c8f53091-dd63-4e75-b222-c313f4778015" (UID: "c8f53091-dd63-4e75-b222-c313f4778015"). InnerVolumeSpecName "kube-api-access-5k2f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:39:39.625881 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.625849    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5k2f7\" (UniqueName: \"kubernetes.io/projected/c8f53091-dd63-4e75-b222-c313f4778015-kube-api-access-5k2f7\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:39.625881 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.625878    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8f53091-dd63-4e75-b222-c313f4778015-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:39.626058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:39.625888    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8f53091-dd63-4e75-b222-c313f4778015-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:40.060894 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.060862    2562 generic.go:356] "Generic (PLEG): container finished" podID="c8f53091-dd63-4e75-b222-c313f4778015" containerID="0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94" exitCode=0
Jul 17 11:39:40.061069 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.060904    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"
Jul 17 11:39:40.061069 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.060949    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth" event={"ID":"c8f53091-dd63-4e75-b222-c313f4778015","Type":"ContainerDied","Data":"0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94"}
Jul 17 11:39:40.061069 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.060989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth" event={"ID":"c8f53091-dd63-4e75-b222-c313f4778015","Type":"ContainerDied","Data":"fa24ffd644fe774032289fd25fa19c4c089a3efcc26f7b4ef7e8afd8db87af83"}
Jul 17 11:39:40.061069 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.061008    2562 scope.go:117] "RemoveContainer" containerID="0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94"
Jul 17 11:39:40.069259 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.069245    2562 scope.go:117] "RemoveContainer" containerID="0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94"
Jul 17 11:39:40.069500 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:39:40.069481    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94\": container with ID starting with 0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94 not found: ID does not exist" containerID="0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94"
Jul 17 11:39:40.069541 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.069510    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94"} err="failed to get container status \"0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94\": rpc error: code = NotFound desc = could not find container \"0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94\": container with ID starting with 0038ac5bb70d3bb1281080b0b5709f261213473c7abcd563b4efc6a6f6098e94 not found: ID does not exist"
Jul 17 11:39:40.094142 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.094114    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"]
Jul 17 11:39:40.110587 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.110564    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4da7d6/test-model-4da7d6-kserve-5b5567c48f-k9mth"]
Jul 17 11:39:40.171552 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.171509    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p" podUID="191dc5ad-1f77-4d30-ad20-51bffe349d0c" containerName="main" containerID="cri-o://d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c" gracePeriod=45
Jul 17 11:39:40.423197 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.423172    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:39:40.429105 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.429059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:40.533912 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.533881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-model-cache\") pod \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") "
Jul 17 11:39:40.534116 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.533923    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-dshm\") pod \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") "
Jul 17 11:39:40.534116 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.534022    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tmp-dir\") pod \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") "
Jul 17 11:39:40.534116 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.534046    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-home\") pod \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") "
Jul 17 11:39:40.534116 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.534086    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tls-certs\") pod \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") "
Jul 17 11:39:40.534336 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.534142    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lht5m\" (UniqueName: \"kubernetes.io/projected/191dc5ad-1f77-4d30-ad20-51bffe349d0c-kube-api-access-lht5m\") pod \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\" (UID: \"191dc5ad-1f77-4d30-ad20-51bffe349d0c\") "
Jul 17 11:39:40.534336 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.534194    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-model-cache" (OuterVolumeSpecName: "model-cache") pod "191dc5ad-1f77-4d30-ad20-51bffe349d0c" (UID: "191dc5ad-1f77-4d30-ad20-51bffe349d0c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:39:40.534446 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.534324    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "191dc5ad-1f77-4d30-ad20-51bffe349d0c" (UID: "191dc5ad-1f77-4d30-ad20-51bffe349d0c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:39:40.534637 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.534424    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-home" (OuterVolumeSpecName: "home") pod "191dc5ad-1f77-4d30-ad20-51bffe349d0c" (UID: "191dc5ad-1f77-4d30-ad20-51bffe349d0c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:39:40.534637 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.534452    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:40.536542 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.536512    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-dshm" (OuterVolumeSpecName: "dshm") pod "191dc5ad-1f77-4d30-ad20-51bffe349d0c" (UID: "191dc5ad-1f77-4d30-ad20-51bffe349d0c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:39:40.536700 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.536685    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "191dc5ad-1f77-4d30-ad20-51bffe349d0c" (UID: "191dc5ad-1f77-4d30-ad20-51bffe349d0c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:39:40.536764 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.536700    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/191dc5ad-1f77-4d30-ad20-51bffe349d0c-kube-api-access-lht5m" (OuterVolumeSpecName: "kube-api-access-lht5m") pod "191dc5ad-1f77-4d30-ad20-51bffe349d0c" (UID: "191dc5ad-1f77-4d30-ad20-51bffe349d0c"). InnerVolumeSpecName "kube-api-access-lht5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:39:40.635342 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.635305    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:40.635342 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.635333    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:40.635342 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.635343    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/191dc5ad-1f77-4d30-ad20-51bffe349d0c-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:40.635556 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.635352    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/191dc5ad-1f77-4d30-ad20-51bffe349d0c-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:40.635556 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:40.635361    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lht5m\" (UniqueName: \"kubernetes.io/projected/191dc5ad-1f77-4d30-ad20-51bffe349d0c-kube-api-access-lht5m\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:41.068196 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.068106    2562 generic.go:356] "Generic (PLEG): container finished" podID="191dc5ad-1f77-4d30-ad20-51bffe349d0c" containerID="d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c" exitCode=0
Jul 17 11:39:41.068196 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.068156    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"
Jul 17 11:39:41.068196 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.068157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p" event={"ID":"191dc5ad-1f77-4d30-ad20-51bffe349d0c","Type":"ContainerDied","Data":"d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c"}
Jul 17 11:39:41.068196 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.068195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p" event={"ID":"191dc5ad-1f77-4d30-ad20-51bffe349d0c","Type":"ContainerDied","Data":"82da5409d6e0881c9a1ee2623c69b757b0a0fae31ecdc22573bca8a9ea414e71"}
Jul 17 11:39:41.068454 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.068216    2562 scope.go:117] "RemoveContainer" containerID="d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c"
Jul 17 11:39:41.077097 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.077057    2562 scope.go:117] "RemoveContainer" containerID="d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c"
Jul 17 11:39:41.077349 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:39:41.077328    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c\": container with ID starting with d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c not found: ID does not exist" containerID="d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c"
Jul 17 11:39:41.077419 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.077358    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c"} err="failed to get container status \"d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c\": rpc error: code = NotFound desc = could not find container \"d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c\": container with ID starting with d239114aca22062afa1846ad39cc62b00a35843adc88744dd757911e89b8335c not found: ID does not exist"
Jul 17 11:39:41.098444 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.098415    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"]
Jul 17 11:39:41.103187 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.103165    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-b18220/test-model-b18220-kserve-858779b5c9-tgr8p"]
Jul 17 11:39:41.680690 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.680658    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="191dc5ad-1f77-4d30-ad20-51bffe349d0c" path="/var/lib/kubelet/pods/191dc5ad-1f77-4d30-ad20-51bffe349d0c/volumes"
Jul 17 11:39:41.681095 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:41.681032    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8f53091-dd63-4e75-b222-c313f4778015" path="/var/lib/kubelet/pods/c8f53091-dd63-4e75-b222-c313f4778015/volumes"
Jul 17 11:39:46.913306 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:46.913270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:47.008673 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:47.008640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:51.108286 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.108255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:51.342782 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.342749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:51.457839 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.457764    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"]
Jul 17 11:39:51.458165 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.458150    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8f53091-dd63-4e75-b222-c313f4778015" containerName="main"
Jul 17 11:39:51.458216 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.458167    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8f53091-dd63-4e75-b222-c313f4778015" containerName="main"
Jul 17 11:39:51.458216 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.458178    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="191dc5ad-1f77-4d30-ad20-51bffe349d0c" containerName="main"
Jul 17 11:39:51.458216 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.458183    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="191dc5ad-1f77-4d30-ad20-51bffe349d0c" containerName="main"
Jul 17 11:39:51.458318 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.458245    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8f53091-dd63-4e75-b222-c313f4778015" containerName="main"
Jul 17 11:39:51.458318 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.458256    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="191dc5ad-1f77-4d30-ad20-51bffe349d0c" containerName="main"
Jul 17 11:39:51.461349 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.461330    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"
Jul 17 11:39:51.463911 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.463889    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:39:51.464101 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.464068    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:39:51.470042 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.470010    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"]
Jul 17 11:39:51.533631 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.533597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b76ccc53-37c2-405e-aeef-8e2268c99e96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b18220-54jlm\" (UID: \"b76ccc53-37c2-405e-aeef-8e2268c99e96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"
Jul 17 11:39:51.634437 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.634401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b76ccc53-37c2-405e-aeef-8e2268c99e96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b18220-54jlm\" (UID: \"b76ccc53-37c2-405e-aeef-8e2268c99e96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"
Jul 17 11:39:51.635024 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.635006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b76ccc53-37c2-405e-aeef-8e2268c99e96-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b18220-54jlm\" (UID: \"b76ccc53-37c2-405e-aeef-8e2268c99e96\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"
Jul 17 11:39:51.773603 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.773514    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"
Jul 17 11:39:51.904512 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.904489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"]
Jul 17 11:39:51.906816 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:39:51.906791    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76ccc53_37c2_405e_aeef_8e2268c99e96.slice/crio-0c60ac81a6a3f02dbc592c952cb456abe34cb65611cfa3f513e180523bc544c2 WatchSource:0}: Error finding container 0c60ac81a6a3f02dbc592c952cb456abe34cb65611cfa3f513e180523bc544c2: Status 404 returned error can't find the container with id 0c60ac81a6a3f02dbc592c952cb456abe34cb65611cfa3f513e180523bc544c2
Jul 17 11:39:51.981311 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:51.981254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:52.084834 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:52.084751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:39:52.127764 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:52.127730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm" event={"ID":"b76ccc53-37c2-405e-aeef-8e2268c99e96","Type":"ContainerStarted","Data":"0c60ac81a6a3f02dbc592c952cb456abe34cb65611cfa3f513e180523bc544c2"}
Jul 17 11:39:53.134024 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:53.133990    2562 generic.go:356] "Generic (PLEG): container finished" podID="b76ccc53-37c2-405e-aeef-8e2268c99e96" containerID="dfaab8bcb2a4c969ea150626a3ab8f77b4d3154e4979578a51e2c21900c7dbb0" exitCode=0
Jul 17 11:39:53.134432 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:53.134102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm" event={"ID":"b76ccc53-37c2-405e-aeef-8e2268c99e96","Type":"ContainerDied","Data":"dfaab8bcb2a4c969ea150626a3ab8f77b4d3154e4979578a51e2c21900c7dbb0"}
Jul 17 11:39:54.282026 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:54.282003    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"
Jul 17 11:39:54.362795 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:54.362764    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b76ccc53-37c2-405e-aeef-8e2268c99e96-maas-api-service-ca\") pod \"b76ccc53-37c2-405e-aeef-8e2268c99e96\" (UID: \"b76ccc53-37c2-405e-aeef-8e2268c99e96\") "
Jul 17 11:39:54.363172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:54.363148    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b76ccc53-37c2-405e-aeef-8e2268c99e96-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b76ccc53-37c2-405e-aeef-8e2268c99e96" (UID: "b76ccc53-37c2-405e-aeef-8e2268c99e96"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:39:54.463920 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:54.463845    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b76ccc53-37c2-405e-aeef-8e2268c99e96-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:39:55.144531 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:55.144494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm" event={"ID":"b76ccc53-37c2-405e-aeef-8e2268c99e96","Type":"ContainerDied","Data":"0c60ac81a6a3f02dbc592c952cb456abe34cb65611cfa3f513e180523bc544c2"}
Jul 17 11:39:55.144703 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:55.144570    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c60ac81a6a3f02dbc592c952cb456abe34cb65611cfa3f513e180523bc544c2"
Jul 17 11:39:55.144703 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:39:55.144504    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b18220-54jlm"
Jul 17 11:40:02.078635 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:02.078602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:06.603488 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:06.603455    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:12.956113 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:12.956051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:13.099881 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:13.099847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:17.389182 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:17.389148    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"]
Jul 17 11:40:17.389577 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:17.389351    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy" containerID="cri-o://72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534" gracePeriod=30
Jul 17 11:40:17.427341 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:17.427313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:17.627264 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:17.627231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:18.014542 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:18.014507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:18.560795 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:18.560767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:18.854581 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:18.854502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:20.430452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:20.430412    2562 patch_prober.go:28] interesting pod/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 11:40:20.430917 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:20.430486    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 11:40:22.039648 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.039581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:22.160831 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.160797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:22.260394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.260357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:22.636171 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.636141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:22.646519 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.646495    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:40:22.725776 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.725695    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-certs\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.725776 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.725728    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5074efd-985e-48e9-a680-41d914f1e053-istio-podinfo\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.725776 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.725754    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-envoy\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.726055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.725790    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-data\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.726055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.725911    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t856l\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-kube-api-access-t856l\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.726055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.725940    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-istio-token\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.726055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.725969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-socket\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.726055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726043    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-credential-socket\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.726055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726043    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:40:22.726411 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726154    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5074efd-985e-48e9-a680-41d914f1e053-istiod-ca-cert\") pod \"c5074efd-985e-48e9-a680-41d914f1e053\" (UID: \"c5074efd-985e-48e9-a680-41d914f1e053\") "
Jul 17 11:40:22.726411 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726292    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:40:22.726537 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726507    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:40:22.726596 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726565    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.726596 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726585    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-workload-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.726596 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726584    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5074efd-985e-48e9-a680-41d914f1e053-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:40:22.726709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.726650    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:40:22.728276 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.728251    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5074efd-985e-48e9-a680-41d914f1e053-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 11:40:22.728276 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.728251    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:40:22.728435 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.728298    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-kube-api-access-t856l" (OuterVolumeSpecName: "kube-api-access-t856l") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "kube-api-access-t856l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:40:22.728435 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.728419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5074efd-985e-48e9-a680-41d914f1e053" (UID: "c5074efd-985e-48e9-a680-41d914f1e053"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:40:22.793022 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.792993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:22.827753 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.827719    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5074efd-985e-48e9-a680-41d914f1e053-istiod-ca-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.827753 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.827748    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5074efd-985e-48e9-a680-41d914f1e053-istio-podinfo\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.827753 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.827758    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-envoy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.827978 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.827766    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-istio-data\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.827978 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.827774    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t856l\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-kube-api-access-t856l\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.827978 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.827783    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5074efd-985e-48e9-a680-41d914f1e053-istio-token\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.827978 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.827791    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5074efd-985e-48e9-a680-41d914f1e053-credential-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:22.915584 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:22.915545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:23.280206 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.280169    2562 generic.go:356] "Generic (PLEG): container finished" podID="c5074efd-985e-48e9-a680-41d914f1e053" containerID="72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534" exitCode=0
Jul 17 11:40:23.280607 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.280223    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"
Jul 17 11:40:23.280607 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.280222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" event={"ID":"c5074efd-985e-48e9-a680-41d914f1e053","Type":"ContainerDied","Data":"72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534"}
Jul 17 11:40:23.280607 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.280345    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr" event={"ID":"c5074efd-985e-48e9-a680-41d914f1e053","Type":"ContainerDied","Data":"8c01215bd79235a0911a83bbe8e1d0de1472d58cf723a230b1759cc2b799f325"}
Jul 17 11:40:23.280607 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.280372    2562 scope.go:117] "RemoveContainer" containerID="72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534"
Jul 17 11:40:23.289930 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.289907    2562 scope.go:117] "RemoveContainer" containerID="ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926"
Jul 17 11:40:23.297608 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.297590    2562 scope.go:117] "RemoveContainer" containerID="72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534"
Jul 17 11:40:23.297869 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:40:23.297849    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534\": container with ID starting with 72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534 not found: ID does not exist" containerID="72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534"
Jul 17 11:40:23.297914 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.297876    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534"} err="failed to get container status \"72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534\": rpc error: code = NotFound desc = could not find container \"72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534\": container with ID starting with 72b5565bbe01ce0fca94f0465d33413812ba2f12f800a1a2d2886f3447736534 not found: ID does not exist"
Jul 17 11:40:23.297914 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.297892    2562 scope.go:117] "RemoveContainer" containerID="ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926"
Jul 17 11:40:23.298133 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:40:23.298113    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926\": container with ID starting with ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926 not found: ID does not exist" containerID="ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926"
Jul 17 11:40:23.298192 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.298140    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926"} err="failed to get container status \"ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926\": rpc error: code = NotFound desc = could not find container \"ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926\": container with ID starting with ec7ad5a1a65f3a70a0cbae865a30d9172b4a9597a4a0f47b60eb3c9652468926 not found: ID does not exist"
Jul 17 11:40:23.302953 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.302928    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"]
Jul 17 11:40:23.307477 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.307455    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b18220-openshift-default-9cffb8657-xc6lr"]
Jul 17 11:40:23.681952 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:23.681919    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5074efd-985e-48e9-a680-41d914f1e053" path="/var/lib/kubelet/pods/c5074efd-985e-48e9-a680-41d914f1e053/volumes"
Jul 17 11:40:25.664873 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:25.664844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:26.525548 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:26.525518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:26.995103 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:26.995047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:27.294646 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.294561    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"]
Jul 17 11:40:27.294970 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.294955    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy"
Jul 17 11:40:27.295033 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.294971    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy"
Jul 17 11:40:27.295033 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.294979    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy"
Jul 17 11:40:27.295033 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.294986    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy"
Jul 17 11:40:27.295033 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.295005    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b76ccc53-37c2-405e-aeef-8e2268c99e96" containerName="revoke-keys"
Jul 17 11:40:27.295033 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.295010    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b76ccc53-37c2-405e-aeef-8e2268c99e96" containerName="revoke-keys"
Jul 17 11:40:27.295220 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.295071    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy"
Jul 17 11:40:27.295220 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.295103    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5074efd-985e-48e9-a680-41d914f1e053" containerName="istio-proxy"
Jul 17 11:40:27.295220 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.295111    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b76ccc53-37c2-405e-aeef-8e2268c99e96" containerName="revoke-keys"
Jul 17 11:40:27.299696 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.299673    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.304942 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.304921    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-42637c-openshift-default-dockercfg-pll57\""
Jul 17 11:40:27.315242 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.315216    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"]
Jul 17 11:40:27.333644 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.333619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:27.371480 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-certs\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.371594 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-envoy\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.371594 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-credential-socket\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.371594 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-podinfo\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.371594 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chz2f\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-kube-api-access-chz2f\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.371594 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-socket\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.371775 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb34c25-8eee-41ba-b54c-b024b266eda3-istiod-ca-cert\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.371775 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-token\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.371775 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.371649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-data\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473205 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb34c25-8eee-41ba-b54c-b024b266eda3-istiod-ca-cert\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473385 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473215    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-token\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473385 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-data\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473385 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-certs\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473385 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-envoy\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473385 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-credential-socket\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473385 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-podinfo\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473648 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chz2f\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-kube-api-access-chz2f\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473648 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-socket\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473822 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473797    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-credential-socket\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473952 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-certs\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.473952 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.473891    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-socket\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.474052 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.474012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb34c25-8eee-41ba-b54c-b024b266eda3-istiod-ca-cert\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.474052 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.474019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-data\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.475791 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.475772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-envoy\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.476016 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.475998    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-podinfo\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.482354 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.482332    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-token\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.482828 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.482811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chz2f\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-kube-api-access-chz2f\") pod \"e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") " pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.610041 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.610014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:27.642190 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.642163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:27.756722 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.756695    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"]
Jul 17 11:40:27.758045 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:40:27.758008    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb34c25_8eee_41ba_b54c_b024b266eda3.slice/crio-ca161cd71cd9473a05be7a1d6a21e2558f946eb031a885aa72ab2106a716f2dc WatchSource:0}: Error finding container ca161cd71cd9473a05be7a1d6a21e2558f946eb031a885aa72ab2106a716f2dc: Status 404 returned error can't find the container with id ca161cd71cd9473a05be7a1d6a21e2558f946eb031a885aa72ab2106a716f2dc
Jul 17 11:40:27.760182 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.760147    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:40:27.760280 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.760228    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:40:27.760280 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:27.760274    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:40:28.306167 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:28.306134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" event={"ID":"fdb34c25-8eee-41ba-b54c-b024b266eda3","Type":"ContainerStarted","Data":"4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82"}
Jul 17 11:40:28.306629 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:28.306183    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" event={"ID":"fdb34c25-8eee-41ba-b54c-b024b266eda3","Type":"ContainerStarted","Data":"ca161cd71cd9473a05be7a1d6a21e2558f946eb031a885aa72ab2106a716f2dc"}
Jul 17 11:40:28.332182 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:28.332133    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" podStartSLOduration=1.332118882 podStartE2EDuration="1.332118882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:40:28.329559422 +0000 UTC m=+2869.134584939" watchObservedRunningTime="2026-07-17 11:40:28.332118882 +0000 UTC m=+2869.137144366"
Jul 17 11:40:28.610966 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:28.610940    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:28.615881 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:28.615859    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:29.311601 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:29.311571    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:29.312494 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:29.312474    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:30.314133 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:30.314035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:30.411397 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:30.411358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:30.790616 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:30.790585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:31.000603 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:31.000570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:31.348544 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:31.348512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:31.446121 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:31.446068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:34.820950 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:34.820914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:42.923399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:42.923328    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"]
Jul 17 11:40:42.929137 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:42.929109    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"
Jul 17 11:40:42.933167 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:42.933137    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:40:42.933565 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:42.933539    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:40:42.941275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:42.941230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"]
Jul 17 11:40:43.044576 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:43.044532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe9d11c-afa9-407d-a3fe-0e03a6027e24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs\" (UID: \"cbe9d11c-afa9-407d-a3fe-0e03a6027e24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"
Jul 17 11:40:43.145399 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:43.145356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe9d11c-afa9-407d-a3fe-0e03a6027e24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs\" (UID: \"cbe9d11c-afa9-407d-a3fe-0e03a6027e24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"
Jul 17 11:40:43.145993 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:43.145973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe9d11c-afa9-407d-a3fe-0e03a6027e24-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs\" (UID: \"cbe9d11c-afa9-407d-a3fe-0e03a6027e24\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"
Jul 17 11:40:43.245874 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:43.245780    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"
Jul 17 11:40:43.398114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:43.398056    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"]
Jul 17 11:40:43.401240 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:40:43.401214    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe9d11c_afa9_407d_a3fe_0e03a6027e24.slice/crio-e427cc69a2ff9909e9d2a08377ec743b398d167aafa61086802c929d02f6e827 WatchSource:0}: Error finding container e427cc69a2ff9909e9d2a08377ec743b398d167aafa61086802c929d02f6e827: Status 404 returned error can't find the container with id e427cc69a2ff9909e9d2a08377ec743b398d167aafa61086802c929d02f6e827
Jul 17 11:40:43.712172 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:43.712142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:43.818300 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:43.818264    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:44.389693 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:44.389655    2562 generic.go:356] "Generic (PLEG): container finished" podID="cbe9d11c-afa9-407d-a3fe-0e03a6027e24" containerID="669567b33a6fec0e45c60ab7c7ce488e29cf9edde5fc83b8bfd47d12350291dd" exitCode=0
Jul 17 11:40:44.390127 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:44.389708    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs" event={"ID":"cbe9d11c-afa9-407d-a3fe-0e03a6027e24","Type":"ContainerDied","Data":"669567b33a6fec0e45c60ab7c7ce488e29cf9edde5fc83b8bfd47d12350291dd"}
Jul 17 11:40:44.390127 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:44.389755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs" event={"ID":"cbe9d11c-afa9-407d-a3fe-0e03a6027e24","Type":"ContainerStarted","Data":"e427cc69a2ff9909e9d2a08377ec743b398d167aafa61086802c929d02f6e827"}
Jul 17 11:40:45.352229 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:45.352190    2562 patch_prober.go:28] interesting pod/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 11:40:45.352402 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:45.352253    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 11:40:45.539184 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:45.539161    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"
Jul 17 11:40:45.671631 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:45.671601    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe9d11c-afa9-407d-a3fe-0e03a6027e24-maas-api-service-ca\") pod \"cbe9d11c-afa9-407d-a3fe-0e03a6027e24\" (UID: \"cbe9d11c-afa9-407d-a3fe-0e03a6027e24\") "
Jul 17 11:40:45.672065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:45.672038    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbe9d11c-afa9-407d-a3fe-0e03a6027e24-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cbe9d11c-afa9-407d-a3fe-0e03a6027e24" (UID: "cbe9d11c-afa9-407d-a3fe-0e03a6027e24"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:40:45.773288 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:45.773256    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbe9d11c-afa9-407d-a3fe-0e03a6027e24-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:40:46.401431 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:46.401407    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs"
Jul 17 11:40:46.403413 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:46.401442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs" event={"ID":"cbe9d11c-afa9-407d-a3fe-0e03a6027e24","Type":"ContainerDied","Data":"e427cc69a2ff9909e9d2a08377ec743b398d167aafa61086802c929d02f6e827"}
Jul 17 11:40:46.403413 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:46.401488    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e427cc69a2ff9909e9d2a08377ec743b398d167aafa61086802c929d02f6e827"
Jul 17 11:40:47.407566 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:47.407533    2562 generic.go:356] "Generic (PLEG): container finished" podID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerID="4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82" exitCode=0
Jul 17 11:40:47.407958 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:47.407606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" event={"ID":"fdb34c25-8eee-41ba-b54c-b024b266eda3","Type":"ContainerDied","Data":"4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82"}
Jul 17 11:40:47.408001 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:47.407988    2562 scope.go:117] "RemoveContainer" containerID="4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82"
Jul 17 11:40:47.408960 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:47.408931    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:40:47.409097 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:47.409016    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:40:47.409169 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:47.409102    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:40:48.413941 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:48.413907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" event={"ID":"fdb34c25-8eee-41ba-b54c-b024b266eda3","Type":"ContainerStarted","Data":"fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d"}
Jul 17 11:40:48.610599 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:48.610557    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:48.610792 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:48.610760    2562 patch_prober.go:28] interesting pod/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 17 11:40:48.610845 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:48.610825    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 17 11:40:49.610547 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:49.610513    2562 patch_prober.go:28] interesting pod/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 17 11:40:49.610935 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:49.610568    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 17 11:40:50.610960 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:50.610922    2562 patch_prober.go:28] interesting pod/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 17 11:40:50.611383 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:50.610989    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 17 11:40:51.610804 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:51.610772    2562 patch_prober.go:28] interesting pod/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 17 11:40:51.610974 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:51.610836    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 17 11:40:52.298130 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:52.298072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:52.400681 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:52.400646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:52.613654 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:52.613627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:52.613915 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:52.613896    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:52.614629 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:52.614612    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:40:53.109087 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:53.109048    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:40:58.040925 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:40:58.040889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:04.108820 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:04.108783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:04.209187 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:04.209154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:08.758524 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:08.758488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:09.004987 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.004950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:09.145918 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.145884    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"]
Jul 17 11:41:09.146274 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.146261    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbe9d11c-afa9-407d-a3fe-0e03a6027e24" containerName="revoke-keys"
Jul 17 11:41:09.146274 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.146274    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbe9d11c-afa9-407d-a3fe-0e03a6027e24" containerName="revoke-keys"
Jul 17 11:41:09.146386 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.146357    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbe9d11c-afa9-407d-a3fe-0e03a6027e24" containerName="revoke-keys"
Jul 17 11:41:09.149898 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.149879    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"
Jul 17 11:41:09.152877 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.152856    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:41:09.152983 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.152897    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:41:09.158668 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.158641    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"]
Jul 17 11:41:09.194193 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.194166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9127735-cf87-48dd-94bf-46b6df3fa199-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-42637c-xvr7g\" (UID: \"e9127735-cf87-48dd-94bf-46b6df3fa199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"
Jul 17 11:41:09.294750 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.294716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9127735-cf87-48dd-94bf-46b6df3fa199-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-42637c-xvr7g\" (UID: \"e9127735-cf87-48dd-94bf-46b6df3fa199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"
Jul 17 11:41:09.295370 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.295351    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9127735-cf87-48dd-94bf-46b6df3fa199-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-42637c-xvr7g\" (UID: \"e9127735-cf87-48dd-94bf-46b6df3fa199\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"
Jul 17 11:41:09.461445 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.461343    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"
Jul 17 11:41:09.598693 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:09.598667    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"]
Jul 17 11:41:09.600329 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:41:09.600306    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9127735_cf87_48dd_94bf_46b6df3fa199.slice/crio-a44350c011f0985327a09fb5e641b57483ead5199d847024cd8799d18f76a65b WatchSource:0}: Error finding container a44350c011f0985327a09fb5e641b57483ead5199d847024cd8799d18f76a65b: Status 404 returned error can't find the container with id a44350c011f0985327a09fb5e641b57483ead5199d847024cd8799d18f76a65b
Jul 17 11:41:10.527087 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:10.527048    2562 generic.go:356] "Generic (PLEG): container finished" podID="e9127735-cf87-48dd-94bf-46b6df3fa199" containerID="75e10959c52f40c791b7ac0e4003801797ee61c2fd2ed96224146f0258b831a2" exitCode=0
Jul 17 11:41:10.527471 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:10.527110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g" event={"ID":"e9127735-cf87-48dd-94bf-46b6df3fa199","Type":"ContainerDied","Data":"75e10959c52f40c791b7ac0e4003801797ee61c2fd2ed96224146f0258b831a2"}
Jul 17 11:41:10.527471 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:10.527176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g" event={"ID":"e9127735-cf87-48dd-94bf-46b6df3fa199","Type":"ContainerStarted","Data":"a44350c011f0985327a09fb5e641b57483ead5199d847024cd8799d18f76a65b"}
Jul 17 11:41:11.671398 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:11.671368    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"
Jul 17 11:41:11.711763 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:11.711733    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9127735-cf87-48dd-94bf-46b6df3fa199-maas-api-service-ca\") pod \"e9127735-cf87-48dd-94bf-46b6df3fa199\" (UID: \"e9127735-cf87-48dd-94bf-46b6df3fa199\") "
Jul 17 11:41:11.712107 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:11.712053    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9127735-cf87-48dd-94bf-46b6df3fa199-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9127735-cf87-48dd-94bf-46b6df3fa199" (UID: "e9127735-cf87-48dd-94bf-46b6df3fa199"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:41:11.812963 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:11.812885    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9127735-cf87-48dd-94bf-46b6df3fa199-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:12.537926 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:12.537899    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g"
Jul 17 11:41:12.538128 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:12.537893    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-42637c-xvr7g" event={"ID":"e9127735-cf87-48dd-94bf-46b6df3fa199","Type":"ContainerDied","Data":"a44350c011f0985327a09fb5e641b57483ead5199d847024cd8799d18f76a65b"}
Jul 17 11:41:12.538128 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:12.538025    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a44350c011f0985327a09fb5e641b57483ead5199d847024cd8799d18f76a65b"
Jul 17 11:41:19.658369 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:19.658321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:24.230912 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:24.230881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:30.289196 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:30.289159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:30.364630 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:30.364596    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:34.984590 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:34.984555    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"]
Jul 17 11:41:34.984955 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:34.984774    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy" containerID="cri-o://fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d" gracePeriod=30
Jul 17 11:41:35.025536 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:35.025506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:35.249764 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:35.249681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:35.585494 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:35.585415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:35.925704 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:35.925675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:36.173857 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:36.173824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:37.616916 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:37.616876    2562 patch_prober.go:28] interesting pod/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 11:41:37.617327 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:37.616945    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 11:41:39.298544 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:39.298505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:39.395870 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:39.395842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:39.496766 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:39.496721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:39.691778 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:39.691742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:40.148091 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.148046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:40.262475 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.262452    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:41:40.294735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.294682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:40.387680 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.387650    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chz2f\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-kube-api-access-chz2f\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.387695    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-credential-socket\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.387767    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb34c25-8eee-41ba-b54c-b024b266eda3-istiod-ca-cert\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.387807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-certs\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.387835    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-podinfo\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.387861    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-token\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.387895    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-socket\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388036    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388103    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388117    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-envoy\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388144    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdb34c25-8eee-41ba-b54c-b024b266eda3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:41:40.388735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388174    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-data\") pod \"fdb34c25-8eee-41ba-b54c-b024b266eda3\" (UID: \"fdb34c25-8eee-41ba-b54c-b024b266eda3\") "
Jul 17 11:41:40.388735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388260    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:40.388735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388608    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.388735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388627    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-workload-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.388735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388640    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-credential-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.388735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388654    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb34c25-8eee-41ba-b54c-b024b266eda3-istiod-ca-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.389066 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.388835    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-data" (OuterVolumeSpecName: "istio-data") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:40.390101 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.390061    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-token" (OuterVolumeSpecName: "istio-token") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:41:40.390260 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.390246    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:41:40.390354 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.390340    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 11:41:40.390446 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.390424    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-kube-api-access-chz2f" (OuterVolumeSpecName: "kube-api-access-chz2f") pod "fdb34c25-8eee-41ba-b54c-b024b266eda3" (UID: "fdb34c25-8eee-41ba-b54c-b024b266eda3"). InnerVolumeSpecName "kube-api-access-chz2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:41:40.489801 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.489771    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-envoy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.489801 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.489793    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-data\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.489801 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.489802    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chz2f\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-kube-api-access-chz2f\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.490023 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.489811    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-podinfo\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.490023 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.489820    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb34c25-8eee-41ba-b54c-b024b266eda3-istio-token\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:41:40.675042 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.675007    2562 generic.go:356] "Generic (PLEG): container finished" podID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerID="fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d" exitCode=0
Jul 17 11:41:40.675237 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.675049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" event={"ID":"fdb34c25-8eee-41ba-b54c-b024b266eda3","Type":"ContainerDied","Data":"fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d"}
Jul 17 11:41:40.675237 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.675067    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"
Jul 17 11:41:40.675237 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.675102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f" event={"ID":"fdb34c25-8eee-41ba-b54c-b024b266eda3","Type":"ContainerDied","Data":"ca161cd71cd9473a05be7a1d6a21e2558f946eb031a885aa72ab2106a716f2dc"}
Jul 17 11:41:40.675237 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.675125    2562 scope.go:117] "RemoveContainer" containerID="fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d"
Jul 17 11:41:40.684227 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.684205    2562 scope.go:117] "RemoveContainer" containerID="4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82"
Jul 17 11:41:40.692336 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.692320    2562 scope.go:117] "RemoveContainer" containerID="fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d"
Jul 17 11:41:40.692602 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:41:40.692584    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d\": container with ID starting with fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d not found: ID does not exist" containerID="fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d"
Jul 17 11:41:40.692649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.692610    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d"} err="failed to get container status \"fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d\": rpc error: code = NotFound desc = could not find container \"fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d\": container with ID starting with fa1537bf612303738f1637bb2a5d273eecc1d31ab9bb12858d07d9cdbe46af2d not found: ID does not exist"
Jul 17 11:41:40.692649 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.692627    2562 scope.go:117] "RemoveContainer" containerID="4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82"
Jul 17 11:41:40.692876 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:41:40.692857    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82\": container with ID starting with 4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82 not found: ID does not exist" containerID="4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82"
Jul 17 11:41:40.692915 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.692887    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82"} err="failed to get container status \"4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82\": rpc error: code = NotFound desc = could not find container \"4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82\": container with ID starting with 4f3b179262da65c7381a7e10f7ac59099b9a61899b3b385a842a54a65c150d82 not found: ID does not exist"
Jul 17 11:41:40.707180 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.707155    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"]
Jul 17 11:41:40.713771 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:40.713751    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-42637c-openshift-default-7b7bf4bff5-jdp2f"]
Jul 17 11:41:41.684323 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:41.684290    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" path="/var/lib/kubelet/pods/fdb34c25-8eee-41ba-b54c-b024b266eda3/volumes"
Jul 17 11:41:43.824565 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:43.824531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:44.214635 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.214606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:44.493451 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493376    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"]
Jul 17 11:41:44.493742 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493728    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy"
Jul 17 11:41:44.493784 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493744    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy"
Jul 17 11:41:44.493784 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493754    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9127735-cf87-48dd-94bf-46b6df3fa199" containerName="revoke-keys"
Jul 17 11:41:44.493784 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493762    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9127735-cf87-48dd-94bf-46b6df3fa199" containerName="revoke-keys"
Jul 17 11:41:44.493887 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493784    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy"
Jul 17 11:41:44.493887 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493790    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy"
Jul 17 11:41:44.493887 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493844    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy"
Jul 17 11:41:44.493887 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.493852    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9127735-cf87-48dd-94bf-46b6df3fa199" containerName="revoke-keys"
Jul 17 11:41:44.498383 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.498352    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.501131 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.501111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-7df590-openshift-default-dockercfg-xsq4t\""
Jul 17 11:41:44.508853 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.508831    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"]
Jul 17 11:41:44.510992 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.510970    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:44.523149 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-certs\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.523256 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-credential-socket\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.523256 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-data\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.523256 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-envoy\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.523364 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-token\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.523364 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-podinfo\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.523432 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8950e84-1258-4f6a-8045-22fa0d65871d-istiod-ca-cert\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.523432 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-socket\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.523495 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.523447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlpbd\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-kube-api-access-jlpbd\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624141 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-certs\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624329 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-credential-socket\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624329 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-data\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624329 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-envoy\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624329 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-token\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624329 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-podinfo\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624604 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8950e84-1258-4f6a-8045-22fa0d65871d-istiod-ca-cert\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624604 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-socket\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624604 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlpbd\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-kube-api-access-jlpbd\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624604 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624566    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-certs\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624837 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-data\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624837 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-socket\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.624952 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.624878    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-credential-socket\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.625117 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.625097    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8950e84-1258-4f6a-8045-22fa0d65871d-istiod-ca-cert\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.626577 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.626559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-envoy\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.626798 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.626782    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-podinfo\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.637329 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.637296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-token\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.637925 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.637905    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlpbd\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-kube-api-access-jlpbd\") pod \"e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") " pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.679260 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.679215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:44.809938 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.809846    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:44.952355 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.952332    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"]
Jul 17 11:41:44.954241 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:41:44.954210    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8950e84_1258_4f6a_8045_22fa0d65871d.slice/crio-ee263d5122d23d130c7f9ce21b917d5eae310af3120f74195fe9c92d9b36ad4e WatchSource:0}: Error finding container ee263d5122d23d130c7f9ce21b917d5eae310af3120f74195fe9c92d9b36ad4e: Status 404 returned error can't find the container with id ee263d5122d23d130c7f9ce21b917d5eae310af3120f74195fe9c92d9b36ad4e
Jul 17 11:41:44.956298 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.956267    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:41:44.956366 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.956333    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:41:44.956410 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:44.956363    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:41:45.704396 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:45.704360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" event={"ID":"d8950e84-1258-4f6a-8045-22fa0d65871d","Type":"ContainerStarted","Data":"6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c"}
Jul 17 11:41:45.704586 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:45.704413    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" event={"ID":"d8950e84-1258-4f6a-8045-22fa0d65871d","Type":"ContainerStarted","Data":"ee263d5122d23d130c7f9ce21b917d5eae310af3120f74195fe9c92d9b36ad4e"}
Jul 17 11:41:45.734117 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:45.734039    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" podStartSLOduration=1.734024315 podStartE2EDuration="1.734024315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:41:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:41:45.732204401 +0000 UTC m=+2946.537229887" watchObservedRunningTime="2026-07-17 11:41:45.734024315 +0000 UTC m=+2946.539049801"
Jul 17 11:41:45.810556 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:45.810518    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:46.815723 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:46.815690    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:47.700790 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:47.700755    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:47.714055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:47.714027    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:47.715087 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:47.715059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:47.868682 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:47.868618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:48.011697 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:48.011589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:48.233128 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:48.233095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:48.602647 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:48.602616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:48.705599 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:48.705568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:52.205047 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:52.205013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:53.972609 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:53.972572    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:41:58.774111 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:58.774061    2562 generic.go:356] "Generic (PLEG): container finished" podID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerID="6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c" exitCode=0
Jul 17 11:41:58.774538 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:58.774135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" event={"ID":"d8950e84-1258-4f6a-8045-22fa0d65871d","Type":"ContainerDied","Data":"6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c"}
Jul 17 11:41:58.774538 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:58.774510    2562 scope.go:117] "RemoveContainer" containerID="6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c"
Jul 17 11:41:58.775497 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:58.775471    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:41:58.775549 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:58.775535    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:41:58.775593 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:58.775570    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 11:41:59.780408 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:59.780368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" event={"ID":"d8950e84-1258-4f6a-8045-22fa0d65871d","Type":"ContainerStarted","Data":"9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124"}
Jul 17 11:41:59.810587 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:59.810556    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:41:59.811438 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:59.811413    2562 patch_prober.go:28] interesting pod/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 17 11:41:59.811560 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:41:59.811457    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 17 11:42:00.810995 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:00.810911    2562 patch_prober.go:28] interesting pod/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 17 11:42:00.811474 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:00.810985    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 17 11:42:01.045383 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:01.045342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:01.143450 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:01.143406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:01.810758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:01.810726    2562 patch_prober.go:28] interesting pod/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 17 11:42:01.810942 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:01.810781    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 17 11:42:02.714330 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:02.714294    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:42:02.810828 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:02.810796    2562 patch_prober.go:28] interesting pod/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 17 11:42:02.810997 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:02.810846    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 17 11:42:03.815180 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:03.815147    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:42:03.816258 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:03.816238    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:42:05.425998 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:05.425950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:05.527218 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:05.527186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:10.396794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:10.396765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:10.488828 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:10.488794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:14.440778 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:14.440737    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:15.266274 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.266243    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"]
Jul 17 11:42:15.266782 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.266756    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdb34c25-8eee-41ba-b54c-b024b266eda3" containerName="istio-proxy"
Jul 17 11:42:15.268735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.268719    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.273136 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.273108    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bbe1d4\"/\"openshift-service-ca.crt\""
Jul 17 11:42:15.274161 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.274137    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bbe1d4\"/\"kube-root-ca.crt\""
Jul 17 11:42:15.274251 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.274141    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bbe1d4\"/\"default-dockercfg-6mk26\""
Jul 17 11:42:15.274251 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.274240    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bbe1d4\"/\"auth-test-model-bbe1d4-kserve-self-signed-certs\""
Jul 17 11:42:15.279319 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.279296    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"]
Jul 17 11:42:15.422859 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.422826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-model-cache\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.423039 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.422876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-home\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.423039 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.422901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tls-certs\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.423039 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.422974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tmp-dir\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.423039 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.423012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-dshm\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.423205 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.423053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsksd\" (UniqueName: \"kubernetes.io/projected/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-kube-api-access-gsksd\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-model-cache\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-home\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tls-certs\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tmp-dir\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-dshm\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsksd\" (UniqueName: \"kubernetes.io/projected/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-kube-api-access-gsksd\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524622    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-home\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tmp-dir\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.524709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.524705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-model-cache\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.526577 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.526556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-dshm\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.526759 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.526742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tls-certs\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.532630 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.532605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsksd\" (UniqueName: \"kubernetes.io/projected/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-kube-api-access-gsksd\") pod \"auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") " pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.578258 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.578227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:15.646668 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.646633    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:15.714906 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.714872    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"]
Jul 17 11:42:15.716227 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:42:15.716199    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43a7b3a6_ed10_4955_9e6f_5a63dac993d2.slice/crio-06986689bf0e4ae4a09ef6bbee1c20c9eed63d6f0bcb0df186fdabbf617a13b1 WatchSource:0}: Error finding container 06986689bf0e4ae4a09ef6bbee1c20c9eed63d6f0bcb0df186fdabbf617a13b1: Status 404 returned error can't find the container with id 06986689bf0e4ae4a09ef6bbee1c20c9eed63d6f0bcb0df186fdabbf617a13b1
Jul 17 11:42:15.855963 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.855878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl" event={"ID":"43a7b3a6-ed10-4955-9e6f-5a63dac993d2","Type":"ContainerStarted","Data":"1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46"}
Jul 17 11:42:15.855963 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.855920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl" event={"ID":"43a7b3a6-ed10-4955-9e6f-5a63dac993d2","Type":"ContainerStarted","Data":"06986689bf0e4ae4a09ef6bbee1c20c9eed63d6f0bcb0df186fdabbf617a13b1"}
Jul 17 11:42:15.875017 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:15.874968    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl" podStartSLOduration=0.874952442 podStartE2EDuration="874.952442ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:42:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:42:15.874280502 +0000 UTC m=+2976.679305990" watchObservedRunningTime="2026-07-17 11:42:15.874952442 +0000 UTC m=+2976.679977927"
Jul 17 11:42:25.578651 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:25.578604    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:25.578651 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:25.578661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:25.591569 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:25.591545    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:25.918186 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:25.918158    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:42:33.949899 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.949862    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"]
Jul 17 11:42:33.953445 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.953428    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:33.956331 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.956303    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"kube-root-ca.crt\""
Jul 17 11:42:33.957415 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.957395    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"openshift-service-ca.crt\""
Jul 17 11:42:33.957709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.957690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"default-dockercfg-tnxv6\""
Jul 17 11:42:33.957709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.957702    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"auth-test-model-7df590-kserve-self-signed-certs\""
Jul 17 11:42:33.964447 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.964426    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"]
Jul 17 11:42:33.979804 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.979770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:42:33.992943 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.992916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0509aec-719f-416a-81ab-15d523561379-tls-certs\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:33.993114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.992962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-dshm\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:33.993114 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.992986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhqzt\" (UniqueName: \"kubernetes.io/projected/d0509aec-719f-416a-81ab-15d523561379-kube-api-access-xhqzt\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:33.993214 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.993109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-tmp-dir\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:33.993214 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.993138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-model-cache\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:33.993214 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:33.993163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-home\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.093688 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.093646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-home\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.093871 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.093742    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0509aec-719f-416a-81ab-15d523561379-tls-certs\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.093871 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.093788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-dshm\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.093871 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.093820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhqzt\" (UniqueName: \"kubernetes.io/projected/d0509aec-719f-416a-81ab-15d523561379-kube-api-access-xhqzt\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.094056 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.093886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-tmp-dir\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.094056 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.093912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-model-cache\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.094214 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.094183    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-home\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.094281 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.094241    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-model-cache\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.094360 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.094334    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-tmp-dir\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.096216 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.096191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-dshm\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.096632 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.096609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0509aec-719f-416a-81ab-15d523561379-tls-certs\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.103281 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.103253    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhqzt\" (UniqueName: \"kubernetes.io/projected/d0509aec-719f-416a-81ab-15d523561379-kube-api-access-xhqzt\") pod \"auth-test-model-7df590-kserve-b65fd69d7-nx7mt\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") " pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.264159 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.264044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:34.407794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.407767    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"]
Jul 17 11:42:34.408669 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:42:34.408643    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0509aec_719f_416a_81ab_15d523561379.slice/crio-8c140ca574f75015206494d9033060a2b3f4b6fa1fc1fdab850e2d4bfd3e39d1 WatchSource:0}: Error finding container 8c140ca574f75015206494d9033060a2b3f4b6fa1fc1fdab850e2d4bfd3e39d1: Status 404 returned error can't find the container with id 8c140ca574f75015206494d9033060a2b3f4b6fa1fc1fdab850e2d4bfd3e39d1
Jul 17 11:42:34.952511 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.952476    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt" event={"ID":"d0509aec-719f-416a-81ab-15d523561379","Type":"ContainerStarted","Data":"f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507"}
Jul 17 11:42:34.952915 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.952521    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt" event={"ID":"d0509aec-719f-416a-81ab-15d523561379","Type":"ContainerStarted","Data":"8c140ca574f75015206494d9033060a2b3f4b6fa1fc1fdab850e2d4bfd3e39d1"}
Jul 17 11:42:34.972273 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:34.972218    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt" podStartSLOduration=1.972204379 podStartE2EDuration="1.972204379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:42:34.970387957 +0000 UTC m=+2995.775413422" watchObservedRunningTime="2026-07-17 11:42:34.972204379 +0000 UTC m=+2995.777229864"
Jul 17 11:42:44.264324 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:44.264287    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:44.264324 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:44.264333    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:44.277044 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:44.277012    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:42:45.014562 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:42:45.014532    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:43:37.281141 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:43:37.281035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:44:17.515718 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:17.515683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:44:17.593318 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:17.593289    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:44:34.036906 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:34.036871    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"]
Jul 17 11:44:34.060772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:34.060744    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:44:34.845420 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:34.845387    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"]
Jul 17 11:44:34.868221 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:34.868189    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:44:43.658705 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.658668    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"]
Jul 17 11:44:43.662216 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.662197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.665305 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.665287    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bbe1d4\"/\"sub-test-model-bbe1d4-kserve-self-signed-certs\""
Jul 17 11:44:43.671947 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.671924    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"]
Jul 17 11:44:43.690055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.690027    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:44:43.715349 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.715315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66b0363-1816-404f-badf-cb995fe21c52-tls-certs\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.715508 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.715371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-model-cache\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.715508 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.715439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-tmp-dir\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.715625 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.715509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-home\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.715625 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.715540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-dshm\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.715718 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.715618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkpsk\" (UniqueName: \"kubernetes.io/projected/d66b0363-1816-404f-badf-cb995fe21c52-kube-api-access-jkpsk\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.816773 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.816719    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66b0363-1816-404f-badf-cb995fe21c52-tls-certs\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.816988 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.816796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-model-cache\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.816988 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.816840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-tmp-dir\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.816988 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.816910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-home\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.816988 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.816944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-dshm\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.816988 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.816976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkpsk\" (UniqueName: \"kubernetes.io/projected/d66b0363-1816-404f-badf-cb995fe21c52-kube-api-access-jkpsk\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.817564 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.817537    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-tmp-dir\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.817683 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.817595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-model-cache\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.817726 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.817710    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-home\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.819760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.819735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-dshm\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.819962 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.819940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66b0363-1816-404f-badf-cb995fe21c52-tls-certs\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.826046 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.825997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkpsk\" (UniqueName: \"kubernetes.io/projected/d66b0363-1816-404f-badf-cb995fe21c52-kube-api-access-jkpsk\") pod \"sub-test-model-bbe1d4-kserve-995966c95-fsqvh\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") " pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:43.972822 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:43.972730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:44.107472 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:44.107437    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"]
Jul 17 11:44:44.109269 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:44:44.109242    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd66b0363_1816_404f_badf_cb995fe21c52.slice/crio-edcfde0b0a0f30c9e9095288f60e142231fef424a8105892aa28fd4c7e58a091 WatchSource:0}: Error finding container edcfde0b0a0f30c9e9095288f60e142231fef424a8105892aa28fd4c7e58a091: Status 404 returned error can't find the container with id edcfde0b0a0f30c9e9095288f60e142231fef424a8105892aa28fd4c7e58a091
Jul 17 11:44:44.597705 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:44.597665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh" event={"ID":"d66b0363-1816-404f-badf-cb995fe21c52","Type":"ContainerStarted","Data":"4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb"}
Jul 17 11:44:44.597705 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:44.597711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh" event={"ID":"d66b0363-1816-404f-badf-cb995fe21c52","Type":"ContainerStarted","Data":"edcfde0b0a0f30c9e9095288f60e142231fef424a8105892aa28fd4c7e58a091"}
Jul 17 11:44:44.619846 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:44.619799    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh" podStartSLOduration=1.6197849739999999 podStartE2EDuration="1.619784974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:44:44.617625433 +0000 UTC m=+3125.422650917" watchObservedRunningTime="2026-07-17 11:44:44.619784974 +0000 UTC m=+3125.424810457"
Jul 17 11:44:49.062467 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.062408    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl" podUID="43a7b3a6-ed10-4955-9e6f-5a63dac993d2" containerName="main" containerID="cri-o://1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46" gracePeriod=45
Jul 17 11:44:49.315458 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.315402    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:44:49.373744 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.373709    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-model-cache\") pod \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") "
Jul 17 11:44:49.373892 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.373750    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-dshm\") pod \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") "
Jul 17 11:44:49.373892 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.373839    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsksd\" (UniqueName: \"kubernetes.io/projected/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-kube-api-access-gsksd\") pod \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") "
Jul 17 11:44:49.373892 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.373885    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tmp-dir\") pod \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") "
Jul 17 11:44:49.374034 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.373906    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tls-certs\") pod \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") "
Jul 17 11:44:49.374034 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.373939    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-home\") pod \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\" (UID: \"43a7b3a6-ed10-4955-9e6f-5a63dac993d2\") "
Jul 17 11:44:49.374034 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.373984    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-model-cache" (OuterVolumeSpecName: "model-cache") pod "43a7b3a6-ed10-4955-9e6f-5a63dac993d2" (UID: "43a7b3a6-ed10-4955-9e6f-5a63dac993d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:44:49.374221 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.374147    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "43a7b3a6-ed10-4955-9e6f-5a63dac993d2" (UID: "43a7b3a6-ed10-4955-9e6f-5a63dac993d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:44:49.374221 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.374206    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-home" (OuterVolumeSpecName: "home") pod "43a7b3a6-ed10-4955-9e6f-5a63dac993d2" (UID: "43a7b3a6-ed10-4955-9e6f-5a63dac993d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:44:49.374326 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.374304    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:49.374326 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.374317    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:49.374326 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.374325    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:49.376140 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.376118    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-dshm" (OuterVolumeSpecName: "dshm") pod "43a7b3a6-ed10-4955-9e6f-5a63dac993d2" (UID: "43a7b3a6-ed10-4955-9e6f-5a63dac993d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:44:49.376230 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.376215    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "43a7b3a6-ed10-4955-9e6f-5a63dac993d2" (UID: "43a7b3a6-ed10-4955-9e6f-5a63dac993d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:44:49.376281 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.376261    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-kube-api-access-gsksd" (OuterVolumeSpecName: "kube-api-access-gsksd") pod "43a7b3a6-ed10-4955-9e6f-5a63dac993d2" (UID: "43a7b3a6-ed10-4955-9e6f-5a63dac993d2"). InnerVolumeSpecName "kube-api-access-gsksd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:44:49.475058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.475027    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsksd\" (UniqueName: \"kubernetes.io/projected/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-kube-api-access-gsksd\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:49.475058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.475054    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:49.475058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.475063    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43a7b3a6-ed10-4955-9e6f-5a63dac993d2-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:49.625207 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.625174    2562 generic.go:356] "Generic (PLEG): container finished" podID="43a7b3a6-ed10-4955-9e6f-5a63dac993d2" containerID="1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46" exitCode=0
Jul 17 11:44:49.625387 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.625213    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"
Jul 17 11:44:49.625387 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.625251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl" event={"ID":"43a7b3a6-ed10-4955-9e6f-5a63dac993d2","Type":"ContainerDied","Data":"1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46"}
Jul 17 11:44:49.625387 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.625283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl" event={"ID":"43a7b3a6-ed10-4955-9e6f-5a63dac993d2","Type":"ContainerDied","Data":"06986689bf0e4ae4a09ef6bbee1c20c9eed63d6f0bcb0df186fdabbf617a13b1"}
Jul 17 11:44:49.625387 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.625298    2562 scope.go:117] "RemoveContainer" containerID="1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46"
Jul 17 11:44:49.634470 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.634452    2562 scope.go:117] "RemoveContainer" containerID="1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46"
Jul 17 11:44:49.634726 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:44:49.634708    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46\": container with ID starting with 1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46 not found: ID does not exist" containerID="1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46"
Jul 17 11:44:49.634771 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.634738    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46"} err="failed to get container status \"1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46\": rpc error: code = NotFound desc = could not find container \"1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46\": container with ID starting with 1e777942f615c000a90ca8b0f2ee9079d1fe897f6002a7b39be474fbcb3e7a46 not found: ID does not exist"
Jul 17 11:44:49.646724 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.646700    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"]
Jul 17 11:44:49.653827 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.653807    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/auth-test-model-bbe1d4-kserve-7bb6f49d67-kqzwl"]
Jul 17 11:44:49.680715 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.680688    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43a7b3a6-ed10-4955-9e6f-5a63dac993d2" path="/var/lib/kubelet/pods/43a7b3a6-ed10-4955-9e6f-5a63dac993d2/volumes"
Jul 17 11:44:49.865705 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:49.865656    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt" podUID="d0509aec-719f-416a-81ab-15d523561379" containerName="main" containerID="cri-o://f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507" gracePeriod=45
Jul 17 11:44:50.114333 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.114305    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:44:50.181184 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181151    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-tmp-dir\") pod \"d0509aec-719f-416a-81ab-15d523561379\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") "
Jul 17 11:44:50.181359 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181189    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-model-cache\") pod \"d0509aec-719f-416a-81ab-15d523561379\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") "
Jul 17 11:44:50.181359 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181212    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-home\") pod \"d0509aec-719f-416a-81ab-15d523561379\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") "
Jul 17 11:44:50.181359 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181265    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhqzt\" (UniqueName: \"kubernetes.io/projected/d0509aec-719f-416a-81ab-15d523561379-kube-api-access-xhqzt\") pod \"d0509aec-719f-416a-81ab-15d523561379\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") "
Jul 17 11:44:50.181359 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181289    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-dshm\") pod \"d0509aec-719f-416a-81ab-15d523561379\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") "
Jul 17 11:44:50.181561 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181364    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0509aec-719f-416a-81ab-15d523561379-tls-certs\") pod \"d0509aec-719f-416a-81ab-15d523561379\" (UID: \"d0509aec-719f-416a-81ab-15d523561379\") "
Jul 17 11:44:50.181561 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181474    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0509aec-719f-416a-81ab-15d523561379" (UID: "d0509aec-719f-416a-81ab-15d523561379"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:44:50.181561 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181485    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0509aec-719f-416a-81ab-15d523561379" (UID: "d0509aec-719f-416a-81ab-15d523561379"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:44:50.181561 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181499    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-home" (OuterVolumeSpecName: "home") pod "d0509aec-719f-416a-81ab-15d523561379" (UID: "d0509aec-719f-416a-81ab-15d523561379"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:44:50.181762 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181744    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:50.181813 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181768    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:50.181813 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.181781    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:50.183510 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.183478    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-dshm" (OuterVolumeSpecName: "dshm") pod "d0509aec-719f-416a-81ab-15d523561379" (UID: "d0509aec-719f-416a-81ab-15d523561379"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:44:50.183631 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.183592    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0509aec-719f-416a-81ab-15d523561379-kube-api-access-xhqzt" (OuterVolumeSpecName: "kube-api-access-xhqzt") pod "d0509aec-719f-416a-81ab-15d523561379" (UID: "d0509aec-719f-416a-81ab-15d523561379"). InnerVolumeSpecName "kube-api-access-xhqzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:44:50.183773 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.183755    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0509aec-719f-416a-81ab-15d523561379-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0509aec-719f-416a-81ab-15d523561379" (UID: "d0509aec-719f-416a-81ab-15d523561379"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:44:50.282504 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.282427    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0509aec-719f-416a-81ab-15d523561379-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:50.282504 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.282453    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhqzt\" (UniqueName: \"kubernetes.io/projected/d0509aec-719f-416a-81ab-15d523561379-kube-api-access-xhqzt\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:50.282504 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.282466    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0509aec-719f-416a-81ab-15d523561379-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:44:50.631695 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.631660    2562 generic.go:356] "Generic (PLEG): container finished" podID="d0509aec-719f-416a-81ab-15d523561379" containerID="f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507" exitCode=0
Jul 17 11:44:50.631883 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.631702    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"
Jul 17 11:44:50.631883 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.631743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt" event={"ID":"d0509aec-719f-416a-81ab-15d523561379","Type":"ContainerDied","Data":"f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507"}
Jul 17 11:44:50.631883 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.631787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt" event={"ID":"d0509aec-719f-416a-81ab-15d523561379","Type":"ContainerDied","Data":"8c140ca574f75015206494d9033060a2b3f4b6fa1fc1fdab850e2d4bfd3e39d1"}
Jul 17 11:44:50.631883 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.631810    2562 scope.go:117] "RemoveContainer" containerID="f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507"
Jul 17 11:44:50.640771 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.640755    2562 scope.go:117] "RemoveContainer" containerID="f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507"
Jul 17 11:44:50.641008 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:44:50.640992    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507\": container with ID starting with f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507 not found: ID does not exist" containerID="f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507"
Jul 17 11:44:50.641055 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.641015    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507"} err="failed to get container status \"f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507\": rpc error: code = NotFound desc = could not find container \"f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507\": container with ID starting with f9bd5902d600cf75922a58b2a9e1c0cb7efcebe1b1d6434b7be97838352df507 not found: ID does not exist"
Jul 17 11:44:50.654469 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.654437    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"]
Jul 17 11:44:50.658962 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:50.658938    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/auth-test-model-7df590-kserve-b65fd69d7-nx7mt"]
Jul 17 11:44:51.681214 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:51.681177    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0509aec-719f-416a-81ab-15d523561379" path="/var/lib/kubelet/pods/d0509aec-719f-416a-81ab-15d523561379/volumes"
Jul 17 11:44:53.973338 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:53.973308    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:53.973763 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:53.973352    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:53.985556 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:53.985529    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:54.663281 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:54.663249    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:44:57.452703 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.452671    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"]
Jul 17 11:44:57.453105 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.453019    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a7b3a6-ed10-4955-9e6f-5a63dac993d2" containerName="main"
Jul 17 11:44:57.453105 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.453030    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a7b3a6-ed10-4955-9e6f-5a63dac993d2" containerName="main"
Jul 17 11:44:57.453105 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.453050    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0509aec-719f-416a-81ab-15d523561379" containerName="main"
Jul 17 11:44:57.453105 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.453056    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0509aec-719f-416a-81ab-15d523561379" containerName="main"
Jul 17 11:44:57.453237 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.453133    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a7b3a6-ed10-4955-9e6f-5a63dac993d2" containerName="main"
Jul 17 11:44:57.453237 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.453141    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0509aec-719f-416a-81ab-15d523561379" containerName="main"
Jul 17 11:44:57.457720 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.457705    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.460133 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.460108    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"kube-root-ca.crt\""
Jul 17 11:44:57.461126 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.461103    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"openshift-service-ca.crt\""
Jul 17 11:44:57.461244 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.461141    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"default-dockercfg-tnxv6\""
Jul 17 11:44:57.461244 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.461151    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"sub-test-model-7df590-kserve-self-signed-certs\""
Jul 17 11:44:57.465739 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.465718    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"]
Jul 17 11:44:57.544069 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.544033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:44:57.550867 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.550843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-home\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.550947 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.550887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tmp-dir\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.550987 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.550941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tls-certs\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.551065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.550996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5mrc\" (UniqueName: \"kubernetes.io/projected/64abceaa-dd13-4ce2-8ae2-5506a5f71882-kube-api-access-b5mrc\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.551065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.551019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-dshm\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.551065 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.551047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-model-cache\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.651575 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.651537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tls-certs\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.651774 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.651589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5mrc\" (UniqueName: \"kubernetes.io/projected/64abceaa-dd13-4ce2-8ae2-5506a5f71882-kube-api-access-b5mrc\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.651774 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.651718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-dshm\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.651774 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.651763    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-model-cache\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.651928 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.651881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-home\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.651979 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.651942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tmp-dir\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.652174 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.652157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-model-cache\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.652296 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.652274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-home\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.652360 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.652322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tmp-dir\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.653926 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.653909    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-dshm\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.654145 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.654126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tls-certs\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.660788 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.660766    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5mrc\" (UniqueName: \"kubernetes.io/projected/64abceaa-dd13-4ce2-8ae2-5506a5f71882-kube-api-access-b5mrc\") pod \"sub-test-model-7df590-kserve-55c5bc4d8f-bqf45\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") " pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.767949 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.767863    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:44:57.902583 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:57.902556    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"]
Jul 17 11:44:57.904476 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:44:57.904446    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64abceaa_dd13_4ce2_8ae2_5506a5f71882.slice/crio-4734ac17c148ea05ba25dbe59b6572c5628e0a2c773b728e783e7a0c9e9c2d2b WatchSource:0}: Error finding container 4734ac17c148ea05ba25dbe59b6572c5628e0a2c773b728e783e7a0c9e9c2d2b: Status 404 returned error can't find the container with id 4734ac17c148ea05ba25dbe59b6572c5628e0a2c773b728e783e7a0c9e9c2d2b
Jul 17 11:44:58.676090 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:58.676043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45" event={"ID":"64abceaa-dd13-4ce2-8ae2-5506a5f71882","Type":"ContainerStarted","Data":"3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e"}
Jul 17 11:44:58.676466 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:58.676100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45" event={"ID":"64abceaa-dd13-4ce2-8ae2-5506a5f71882","Type":"ContainerStarted","Data":"4734ac17c148ea05ba25dbe59b6572c5628e0a2c773b728e783e7a0c9e9c2d2b"}
Jul 17 11:44:58.694886 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:44:58.694838    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45" podStartSLOduration=1.694822936 podStartE2EDuration="1.694822936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:44:58.694444601 +0000 UTC m=+3139.499470085" watchObservedRunningTime="2026-07-17 11:44:58.694822936 +0000 UTC m=+3139.499848421"
Jul 17 11:45:07.768418 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:07.768335    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:45:07.768857 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:07.768411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:45:07.780878 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:07.780856    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:45:08.734829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:08.734793    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:45:54.982351 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:54.982315    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"]
Jul 17 11:45:55.029105 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:55.029055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:45:55.745665 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:55.745628    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"]
Jul 17 11:45:55.773760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:55.773719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:45:58.144458 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.144428    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"]
Jul 17 11:45:58.147937 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.147921    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.150936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.150909    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bbe1d4\"/\"rate-test-model-bbe1d4-kserve-self-signed-certs\""
Jul 17 11:45:58.158164 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.158136    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"]
Jul 17 11:45:58.164973 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.164947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:45:58.232488 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.232459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-dshm\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.232657 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.232497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-model-cache\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.232657 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.232518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bb0359a4-5b0d-412b-bb7c-10764dea7068-kube-api-access-pt9fq\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.232657 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.232542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0359a4-5b0d-412b-bb7c-10764dea7068-tls-certs\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.232657 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.232603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-home\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.232657 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.232632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-tmp-dir\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.334168 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.334130    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-tmp-dir\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.334392 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.334213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-dshm\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.334392 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.334257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-model-cache\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.334392 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.334293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bb0359a4-5b0d-412b-bb7c-10764dea7068-kube-api-access-pt9fq\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.334392 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.334325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0359a4-5b0d-412b-bb7c-10764dea7068-tls-certs\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.334621 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.334456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-home\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.334686 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.334627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-tmp-dir\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.335014 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.334986    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-model-cache\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.335538 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.335516    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-home\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.337113 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.337056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-dshm\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.337626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.337607    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0359a4-5b0d-412b-bb7c-10764dea7068-tls-certs\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.343117 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.343099    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bb0359a4-5b0d-412b-bb7c-10764dea7068-kube-api-access-pt9fq\") pod \"rate-test-model-bbe1d4-kserve-7479464f87-6mnnw\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") " pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.459643 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.459543    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:45:58.608064 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:45:58.608035    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb0359a4_5b0d_412b_bb7c_10764dea7068.slice/crio-f21fbcf7d6d53865daadf4013b6a57dc2a4d58246ad09163ccb91fda5b9ec810 WatchSource:0}: Error finding container f21fbcf7d6d53865daadf4013b6a57dc2a4d58246ad09163ccb91fda5b9ec810: Status 404 returned error can't find the container with id f21fbcf7d6d53865daadf4013b6a57dc2a4d58246ad09163ccb91fda5b9ec810
Jul 17 11:45:58.608310 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.608287    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"]
Jul 17 11:45:58.991223 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.991187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw" event={"ID":"bb0359a4-5b0d-412b-bb7c-10764dea7068","Type":"ContainerStarted","Data":"d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a"}
Jul 17 11:45:58.991223 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:58.991229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw" event={"ID":"bb0359a4-5b0d-412b-bb7c-10764dea7068","Type":"ContainerStarted","Data":"f21fbcf7d6d53865daadf4013b6a57dc2a4d58246ad09163ccb91fda5b9ec810"}
Jul 17 11:45:59.017821 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:45:59.014962    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw" podStartSLOduration=1.01493607 podStartE2EDuration="1.01493607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:45:59.010008487 +0000 UTC m=+3199.815033971" watchObservedRunningTime="2026-07-17 11:45:59.01493607 +0000 UTC m=+3199.819961557"
Jul 17 11:46:08.460275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:08.460216    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:46:08.460275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:08.460280    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:46:08.473000 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:08.472973    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:46:09.055306 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:09.055278    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:46:10.001986 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.001934    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh" podUID="d66b0363-1816-404f-badf-cb995fe21c52" containerName="main" containerID="cri-o://4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb" gracePeriod=45
Jul 17 11:46:10.260030 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.259959    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:46:10.367451 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367412    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-model-cache\") pod \"d66b0363-1816-404f-badf-cb995fe21c52\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") "
Jul 17 11:46:10.367626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367461    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-tmp-dir\") pod \"d66b0363-1816-404f-badf-cb995fe21c52\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") "
Jul 17 11:46:10.367626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367547    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-home\") pod \"d66b0363-1816-404f-badf-cb995fe21c52\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") "
Jul 17 11:46:10.367626 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367604    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-dshm\") pod \"d66b0363-1816-404f-badf-cb995fe21c52\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") "
Jul 17 11:46:10.367745 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367627    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkpsk\" (UniqueName: \"kubernetes.io/projected/d66b0363-1816-404f-badf-cb995fe21c52-kube-api-access-jkpsk\") pod \"d66b0363-1816-404f-badf-cb995fe21c52\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") "
Jul 17 11:46:10.367745 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367653    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66b0363-1816-404f-badf-cb995fe21c52-tls-certs\") pod \"d66b0363-1816-404f-badf-cb995fe21c52\" (UID: \"d66b0363-1816-404f-badf-cb995fe21c52\") "
Jul 17 11:46:10.367830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367745    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-model-cache" (OuterVolumeSpecName: "model-cache") pod "d66b0363-1816-404f-badf-cb995fe21c52" (UID: "d66b0363-1816-404f-badf-cb995fe21c52"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:46:10.367830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367754    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d66b0363-1816-404f-badf-cb995fe21c52" (UID: "d66b0363-1816-404f-badf-cb995fe21c52"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:46:10.367830 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367777    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-home" (OuterVolumeSpecName: "home") pod "d66b0363-1816-404f-badf-cb995fe21c52" (UID: "d66b0363-1816-404f-badf-cb995fe21c52"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:46:10.367975 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367954    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:10.368125 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367977    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:10.368125 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.367998    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:10.369812 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.369785    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66b0363-1816-404f-badf-cb995fe21c52-kube-api-access-jkpsk" (OuterVolumeSpecName: "kube-api-access-jkpsk") pod "d66b0363-1816-404f-badf-cb995fe21c52" (UID: "d66b0363-1816-404f-badf-cb995fe21c52"). InnerVolumeSpecName "kube-api-access-jkpsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:46:10.369812 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.369805    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d66b0363-1816-404f-badf-cb995fe21c52-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d66b0363-1816-404f-badf-cb995fe21c52" (UID: "d66b0363-1816-404f-badf-cb995fe21c52"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:46:10.369934 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.369791    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-dshm" (OuterVolumeSpecName: "dshm") pod "d66b0363-1816-404f-badf-cb995fe21c52" (UID: "d66b0363-1816-404f-badf-cb995fe21c52"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:46:10.469463 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.469427    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66b0363-1816-404f-badf-cb995fe21c52-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:10.469463 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.469457    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkpsk\" (UniqueName: \"kubernetes.io/projected/d66b0363-1816-404f-badf-cb995fe21c52-kube-api-access-jkpsk\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:10.469463 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.469468    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66b0363-1816-404f-badf-cb995fe21c52-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:10.765713 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:10.765672    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45" podUID="64abceaa-dd13-4ce2-8ae2-5506a5f71882" containerName="main" containerID="cri-o://3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e" gracePeriod=45
Jul 17 11:46:11.005843 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.005819    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:46:11.055878 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.055805    2562 generic.go:356] "Generic (PLEG): container finished" podID="d66b0363-1816-404f-badf-cb995fe21c52" containerID="4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb" exitCode=0
Jul 17 11:46:11.055878 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.055865    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"
Jul 17 11:46:11.056108 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.055878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh" event={"ID":"d66b0363-1816-404f-badf-cb995fe21c52","Type":"ContainerDied","Data":"4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb"}
Jul 17 11:46:11.056108 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.055915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh" event={"ID":"d66b0363-1816-404f-badf-cb995fe21c52","Type":"ContainerDied","Data":"edcfde0b0a0f30c9e9095288f60e142231fef424a8105892aa28fd4c7e58a091"}
Jul 17 11:46:11.056108 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.055939    2562 scope.go:117] "RemoveContainer" containerID="4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb"
Jul 17 11:46:11.057312 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.057268    2562 generic.go:356] "Generic (PLEG): container finished" podID="64abceaa-dd13-4ce2-8ae2-5506a5f71882" containerID="3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e" exitCode=0
Jul 17 11:46:11.057312 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.057296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45" event={"ID":"64abceaa-dd13-4ce2-8ae2-5506a5f71882","Type":"ContainerDied","Data":"3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e"}
Jul 17 11:46:11.057412 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.057318    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"
Jul 17 11:46:11.057412 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.057339    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45" event={"ID":"64abceaa-dd13-4ce2-8ae2-5506a5f71882","Type":"ContainerDied","Data":"4734ac17c148ea05ba25dbe59b6572c5628e0a2c773b728e783e7a0c9e9c2d2b"}
Jul 17 11:46:11.064746 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.064724    2562 scope.go:117] "RemoveContainer" containerID="4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb"
Jul 17 11:46:11.065030 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:46:11.065002    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb\": container with ID starting with 4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb not found: ID does not exist" containerID="4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb"
Jul 17 11:46:11.065142 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.065042    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb"} err="failed to get container status \"4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb\": rpc error: code = NotFound desc = could not find container \"4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb\": container with ID starting with 4a57226a55da3dceb6c97dc354196341f84593bf45df7d35293db165f8795adb not found: ID does not exist"
Jul 17 11:46:11.065142 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.065066    2562 scope.go:117] "RemoveContainer" containerID="3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e"
Jul 17 11:46:11.072759 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.072742    2562 scope.go:117] "RemoveContainer" containerID="3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e"
Jul 17 11:46:11.072993 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:46:11.072974    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e\": container with ID starting with 3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e not found: ID does not exist" containerID="3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e"
Jul 17 11:46:11.073035 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.073001    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e"} err="failed to get container status \"3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e\": rpc error: code = NotFound desc = could not find container \"3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e\": container with ID starting with 3b3db06e9669488b2f770b5606c6ac2e312d250483034d7afe9b46c413feae9e not found: ID does not exist"
Jul 17 11:46:11.081275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.081253    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"]
Jul 17 11:46:11.085024 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.085000    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/sub-test-model-bbe1d4-kserve-995966c95-fsqvh"]
Jul 17 11:46:11.175778 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.175746    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tmp-dir\") pod \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") "
Jul 17 11:46:11.175927 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.175812    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-home\") pod \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") "
Jul 17 11:46:11.175927 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.175837    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-dshm\") pod \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") "
Jul 17 11:46:11.175927 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.175860    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tls-certs\") pod \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") "
Jul 17 11:46:11.175927 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.175896    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5mrc\" (UniqueName: \"kubernetes.io/projected/64abceaa-dd13-4ce2-8ae2-5506a5f71882-kube-api-access-b5mrc\") pod \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") "
Jul 17 11:46:11.176166 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.175977    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-model-cache\") pod \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\" (UID: \"64abceaa-dd13-4ce2-8ae2-5506a5f71882\") "
Jul 17 11:46:11.176166 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.175983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64abceaa-dd13-4ce2-8ae2-5506a5f71882" (UID: "64abceaa-dd13-4ce2-8ae2-5506a5f71882"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:46:11.176166 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.176130    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-home" (OuterVolumeSpecName: "home") pod "64abceaa-dd13-4ce2-8ae2-5506a5f71882" (UID: "64abceaa-dd13-4ce2-8ae2-5506a5f71882"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:46:11.176328 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.176242    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-model-cache" (OuterVolumeSpecName: "model-cache") pod "64abceaa-dd13-4ce2-8ae2-5506a5f71882" (UID: "64abceaa-dd13-4ce2-8ae2-5506a5f71882"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:46:11.176385 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.176353    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:11.176385 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.176371    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:11.176461 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.176384    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:11.178003 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.177983    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-dshm" (OuterVolumeSpecName: "dshm") pod "64abceaa-dd13-4ce2-8ae2-5506a5f71882" (UID: "64abceaa-dd13-4ce2-8ae2-5506a5f71882"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:46:11.178116 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.178051    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64abceaa-dd13-4ce2-8ae2-5506a5f71882-kube-api-access-b5mrc" (OuterVolumeSpecName: "kube-api-access-b5mrc") pod "64abceaa-dd13-4ce2-8ae2-5506a5f71882" (UID: "64abceaa-dd13-4ce2-8ae2-5506a5f71882"). InnerVolumeSpecName "kube-api-access-b5mrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:46:11.178177 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.178162    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64abceaa-dd13-4ce2-8ae2-5506a5f71882" (UID: "64abceaa-dd13-4ce2-8ae2-5506a5f71882"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:46:11.277560 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.277514    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64abceaa-dd13-4ce2-8ae2-5506a5f71882-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:11.277560 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.277556    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64abceaa-dd13-4ce2-8ae2-5506a5f71882-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:11.277560 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.277566    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5mrc\" (UniqueName: \"kubernetes.io/projected/64abceaa-dd13-4ce2-8ae2-5506a5f71882-kube-api-access-b5mrc\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:46:11.379784 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.379747    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"]
Jul 17 11:46:11.387196 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.387169    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/sub-test-model-7df590-kserve-55c5bc4d8f-bqf45"]
Jul 17 11:46:11.680800 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.680712    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64abceaa-dd13-4ce2-8ae2-5506a5f71882" path="/var/lib/kubelet/pods/64abceaa-dd13-4ce2-8ae2-5506a5f71882/volumes"
Jul 17 11:46:11.681147 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:11.681132    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d66b0363-1816-404f-badf-cb995fe21c52" path="/var/lib/kubelet/pods/d66b0363-1816-404f-badf-cb995fe21c52/volumes"
Jul 17 11:46:22.152677 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.152644    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"]
Jul 17 11:46:22.153067 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.153012    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64abceaa-dd13-4ce2-8ae2-5506a5f71882" containerName="main"
Jul 17 11:46:22.153067 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.153023    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="64abceaa-dd13-4ce2-8ae2-5506a5f71882" containerName="main"
Jul 17 11:46:22.153067 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.153038    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66b0363-1816-404f-badf-cb995fe21c52" containerName="main"
Jul 17 11:46:22.153067 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.153044    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66b0363-1816-404f-badf-cb995fe21c52" containerName="main"
Jul 17 11:46:22.153230 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.153129    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="64abceaa-dd13-4ce2-8ae2-5506a5f71882" containerName="main"
Jul 17 11:46:22.153230 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.153138    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d66b0363-1816-404f-badf-cb995fe21c52" containerName="main"
Jul 17 11:46:22.155934 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.155915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.159608 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.159587    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"openshift-service-ca.crt\""
Jul 17 11:46:22.159724 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.159617    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"rate-test-model-7df590-kserve-self-signed-certs\""
Jul 17 11:46:22.159724 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.159616    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"default-dockercfg-tnxv6\""
Jul 17 11:46:22.159724 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.159592    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7df590\"/\"kube-root-ca.crt\""
Jul 17 11:46:22.168012 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.167990    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"]
Jul 17 11:46:22.176000 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.175972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-dshm\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.176136 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.176016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-model-cache\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.176219 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.176131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tls-certs\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.176219 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.176161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-home\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.176219 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.176178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tmp-dir\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.176219 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.176200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ttcp\" (UniqueName: \"kubernetes.io/projected/fc27ef3e-e9ac-403b-804e-12b6a2b93559-kube-api-access-2ttcp\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.183363 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.183340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:46:22.276702 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.276661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tls-certs\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.276881 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.276708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-home\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.276881 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.276818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tmp-dir\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.276881 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.276865    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ttcp\" (UniqueName: \"kubernetes.io/projected/fc27ef3e-e9ac-403b-804e-12b6a2b93559-kube-api-access-2ttcp\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.277054 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.276921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-dshm\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.277054 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.276972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-model-cache\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.277196 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.277137    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-home\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.277238 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.277188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tmp-dir\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.277327 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.277310    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-model-cache\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.279145 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.279124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-dshm\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.279253 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.279200    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tls-certs\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.285341 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.285322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ttcp\" (UniqueName: \"kubernetes.io/projected/fc27ef3e-e9ac-403b-804e-12b6a2b93559-kube-api-access-2ttcp\") pod \"rate-test-model-7df590-kserve-7d68657495-g8stt\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") " pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.465656 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.465572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:22.604327 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:22.604238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"]
Jul 17 11:46:22.608439 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:46:22.608408    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc27ef3e_e9ac_403b_804e_12b6a2b93559.slice/crio-8b9b61f9b4197e40fe1a810526f1c103aae5b7e7aa45ff0c5335f82f286d5832 WatchSource:0}: Error finding container 8b9b61f9b4197e40fe1a810526f1c103aae5b7e7aa45ff0c5335f82f286d5832: Status 404 returned error can't find the container with id 8b9b61f9b4197e40fe1a810526f1c103aae5b7e7aa45ff0c5335f82f286d5832
Jul 17 11:46:23.121338 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:23.121303    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt" event={"ID":"fc27ef3e-e9ac-403b-804e-12b6a2b93559","Type":"ContainerStarted","Data":"113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29"}
Jul 17 11:46:23.121514 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:23.121347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt" event={"ID":"fc27ef3e-e9ac-403b-804e-12b6a2b93559","Type":"ContainerStarted","Data":"8b9b61f9b4197e40fe1a810526f1c103aae5b7e7aa45ff0c5335f82f286d5832"}
Jul 17 11:46:23.139027 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:23.138969    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt" podStartSLOduration=1.138954234 podStartE2EDuration="1.138954234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:46:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:46:23.137284181 +0000 UTC m=+3223.942309667" watchObservedRunningTime="2026-07-17 11:46:23.138954234 +0000 UTC m=+3223.943979722"
Jul 17 11:46:32.466850 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:32.466755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:32.466850 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:32.466830    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:32.479816 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:32.479787    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:46:33.183452 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:46:33.183421    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:47:01.826285 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:01.826245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:01.927425 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:01.927392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:06.358485 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:06.358449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:06.441153 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:06.441119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:08.902992 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:08.902956    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"]
Jul 17 11:47:09.243422 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:09.243337    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:09.687948 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:09.687920    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"]
Jul 17 11:47:09.706156 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:09.706123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:10.741765 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:10.741730    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7400-140359784722224"]
Jul 17 11:47:10.745251 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:10.745232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784722224"
Jul 17 11:47:10.748186 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:10.748159    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jdtk7\""
Jul 17 11:47:10.752042 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:10.752015    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7400-140359784722224"]
Jul 17 11:47:10.833549 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:10.833512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhdt\" (UniqueName: \"kubernetes.io/projected/034dc275-3c67-4785-8de2-630036fd3c75-kube-api-access-fmhdt\") pod \"test-curl-7400-140359784722224\" (UID: \"034dc275-3c67-4785-8de2-630036fd3c75\") " pod="opendatahub/test-curl-7400-140359784722224"
Jul 17 11:47:10.934330 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:10.934298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhdt\" (UniqueName: \"kubernetes.io/projected/034dc275-3c67-4785-8de2-630036fd3c75-kube-api-access-fmhdt\") pod \"test-curl-7400-140359784722224\" (UID: \"034dc275-3c67-4785-8de2-630036fd3c75\") " pod="opendatahub/test-curl-7400-140359784722224"
Jul 17 11:47:10.947202 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:10.947180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhdt\" (UniqueName: \"kubernetes.io/projected/034dc275-3c67-4785-8de2-630036fd3c75-kube-api-access-fmhdt\") pod \"test-curl-7400-140359784722224\" (UID: \"034dc275-3c67-4785-8de2-630036fd3c75\") " pod="opendatahub/test-curl-7400-140359784722224"
Jul 17 11:47:11.055275 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:11.055197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784722224"
Jul 17 11:47:11.189384 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:11.189361    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7400-140359784722224"]
Jul 17 11:47:11.191797 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:47:11.191770    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod034dc275_3c67_4785_8de2_630036fd3c75.slice/crio-0a26039bf905ae8983311aad168d47fd68bd9682111e5d62eb7061b3edfc0ac2 WatchSource:0}: Error finding container 0a26039bf905ae8983311aad168d47fd68bd9682111e5d62eb7061b3edfc0ac2: Status 404 returned error can't find the container with id 0a26039bf905ae8983311aad168d47fd68bd9682111e5d62eb7061b3edfc0ac2
Jul 17 11:47:11.193441 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:11.193424    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 11:47:11.225362 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:11.225338    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:11.331400 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:11.331307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:11.364465 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:11.364432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7400-140359784722224" event={"ID":"034dc275-3c67-4785-8de2-630036fd3c75","Type":"ContainerStarted","Data":"0a26039bf905ae8983311aad168d47fd68bd9682111e5d62eb7061b3edfc0ac2"}
Jul 17 11:47:12.370676 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:12.370643    2562 generic.go:356] "Generic (PLEG): container finished" podID="034dc275-3c67-4785-8de2-630036fd3c75" containerID="a935ff4b76bad30616b53f69ef587c687198bcab2f8635b605db83b9381e158f" exitCode=0
Jul 17 11:47:12.371066 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:12.370735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7400-140359784722224" event={"ID":"034dc275-3c67-4785-8de2-630036fd3c75","Type":"ContainerDied","Data":"a935ff4b76bad30616b53f69ef587c687198bcab2f8635b605db83b9381e158f"}
Jul 17 11:47:13.511228 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:13.511204    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784722224"
Jul 17 11:47:13.531629 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:13.531598    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7400-140359784722224_034dc275-3c67-4785-8de2-630036fd3c75/test-curl-7400-140359784722224/0.log"
Jul 17 11:47:13.554805 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:13.554767    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7400-140359784722224"]
Jul 17 11:47:13.556577 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:13.556549    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmhdt\" (UniqueName: \"kubernetes.io/projected/034dc275-3c67-4785-8de2-630036fd3c75-kube-api-access-fmhdt\") pod \"034dc275-3c67-4785-8de2-630036fd3c75\" (UID: \"034dc275-3c67-4785-8de2-630036fd3c75\") "
Jul 17 11:47:13.558996 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:13.558970    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034dc275-3c67-4785-8de2-630036fd3c75-kube-api-access-fmhdt" (OuterVolumeSpecName: "kube-api-access-fmhdt") pod "034dc275-3c67-4785-8de2-630036fd3c75" (UID: "034dc275-3c67-4785-8de2-630036fd3c75"). InnerVolumeSpecName "kube-api-access-fmhdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:47:13.559985 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:13.559965    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7400-140359784722224"]
Jul 17 11:47:13.658674 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:13.658586    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmhdt\" (UniqueName: \"kubernetes.io/projected/034dc275-3c67-4785-8de2-630036fd3c75-kube-api-access-fmhdt\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:13.680999 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:13.680969    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="034dc275-3c67-4785-8de2-630036fd3c75" path="/var/lib/kubelet/pods/034dc275-3c67-4785-8de2-630036fd3c75/volumes"
Jul 17 11:47:14.382146 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:14.382115    2562 scope.go:117] "RemoveContainer" containerID="a935ff4b76bad30616b53f69ef587c687198bcab2f8635b605db83b9381e158f"
Jul 17 11:47:14.382146 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:14.382130    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784722224"
Jul 17 11:47:22.594129 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.594069    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:22.594605 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.594495    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="034dc275-3c67-4785-8de2-630036fd3c75" containerName="test-curl-7400-140359784722224"
Jul 17 11:47:22.594605 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.594510    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="034dc275-3c67-4785-8de2-630036fd3c75" containerName="test-curl-7400-140359784722224"
Jul 17 11:47:22.594605 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.594592    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="034dc275-3c67-4785-8de2-630036fd3c75" containerName="test-curl-7400-140359784722224"
Jul 17 11:47:22.597516 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.597500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:22.600581 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.600552    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jdtk7\""
Jul 17 11:47:22.601951 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.601925    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:22.637002 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.636975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfq5t\" (UniqueName: \"kubernetes.io/projected/d9b81515-5883-4796-b338-04fb294bea4b-kube-api-access-wfq5t\") pod \"test-curl-7400-140359784596224\" (UID: \"d9b81515-5883-4796-b338-04fb294bea4b\") " pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:22.738593 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.738559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfq5t\" (UniqueName: \"kubernetes.io/projected/d9b81515-5883-4796-b338-04fb294bea4b-kube-api-access-wfq5t\") pod \"test-curl-7400-140359784596224\" (UID: \"d9b81515-5883-4796-b338-04fb294bea4b\") " pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:22.747394 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.747371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfq5t\" (UniqueName: \"kubernetes.io/projected/d9b81515-5883-4796-b338-04fb294bea4b-kube-api-access-wfq5t\") pod \"test-curl-7400-140359784596224\" (UID: \"d9b81515-5883-4796-b338-04fb294bea4b\") " pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:22.907849 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:22.907811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:23.041693 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:23.041668    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:23.044237 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:47:23.044209    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9b81515_5883_4796_b338_04fb294bea4b.slice/crio-6218fdd3fcaf57cbe7289cc51676a0d7d01b199b98efabc71181bcfd05c6887f WatchSource:0}: Error finding container 6218fdd3fcaf57cbe7289cc51676a0d7d01b199b98efabc71181bcfd05c6887f: Status 404 returned error can't find the container with id 6218fdd3fcaf57cbe7289cc51676a0d7d01b199b98efabc71181bcfd05c6887f
Jul 17 11:47:23.427567 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:23.427541    2562 generic.go:356] "Generic (PLEG): container finished" podID="d9b81515-5883-4796-b338-04fb294bea4b" containerID="473402acff2852f882a4e2f88b709ebd5b0d296d7c15b585d35c9c758ce71b1c" exitCode=0
Jul 17 11:47:23.427686 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:23.427607    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7400-140359784596224" event={"ID":"d9b81515-5883-4796-b338-04fb294bea4b","Type":"ContainerDied","Data":"473402acff2852f882a4e2f88b709ebd5b0d296d7c15b585d35c9c758ce71b1c"}
Jul 17 11:47:23.427686 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:23.427632    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7400-140359784596224" event={"ID":"d9b81515-5883-4796-b338-04fb294bea4b","Type":"ContainerStarted","Data":"6218fdd3fcaf57cbe7289cc51676a0d7d01b199b98efabc71181bcfd05c6887f"}
Jul 17 11:47:23.923213 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:23.923150    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw" podUID="bb0359a4-5b0d-412b-bb7c-10764dea7068" containerName="main" containerID="cri-o://d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a" gracePeriod=45
Jul 17 11:47:24.184398 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.184368    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:47:24.253760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.253729    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0359a4-5b0d-412b-bb7c-10764dea7068-tls-certs\") pod \"bb0359a4-5b0d-412b-bb7c-10764dea7068\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") "
Jul 17 11:47:24.253923 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.253791    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-tmp-dir\") pod \"bb0359a4-5b0d-412b-bb7c-10764dea7068\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") "
Jul 17 11:47:24.253923 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.253814    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-model-cache\") pod \"bb0359a4-5b0d-412b-bb7c-10764dea7068\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") "
Jul 17 11:47:24.253923 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.253912    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-home\") pod \"bb0359a4-5b0d-412b-bb7c-10764dea7068\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") "
Jul 17 11:47:24.254120 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.253973    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-dshm\") pod \"bb0359a4-5b0d-412b-bb7c-10764dea7068\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") "
Jul 17 11:47:24.254120 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.254006    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bb0359a4-5b0d-412b-bb7c-10764dea7068-kube-api-access-pt9fq\") pod \"bb0359a4-5b0d-412b-bb7c-10764dea7068\" (UID: \"bb0359a4-5b0d-412b-bb7c-10764dea7068\") "
Jul 17 11:47:24.254120 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.254040    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb0359a4-5b0d-412b-bb7c-10764dea7068" (UID: "bb0359a4-5b0d-412b-bb7c-10764dea7068"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:47:24.254120 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.254057    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb0359a4-5b0d-412b-bb7c-10764dea7068" (UID: "bb0359a4-5b0d-412b-bb7c-10764dea7068"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:47:24.254334 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.254207    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-home" (OuterVolumeSpecName: "home") pod "bb0359a4-5b0d-412b-bb7c-10764dea7068" (UID: "bb0359a4-5b0d-412b-bb7c-10764dea7068"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:47:24.254442 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.254422    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:24.254518 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.254448    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:24.254518 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.254461    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:24.255874 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.255851    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0359a4-5b0d-412b-bb7c-10764dea7068-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb0359a4-5b0d-412b-bb7c-10764dea7068" (UID: "bb0359a4-5b0d-412b-bb7c-10764dea7068"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:47:24.256006 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.255985    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0359a4-5b0d-412b-bb7c-10764dea7068-kube-api-access-pt9fq" (OuterVolumeSpecName: "kube-api-access-pt9fq") pod "bb0359a4-5b0d-412b-bb7c-10764dea7068" (UID: "bb0359a4-5b0d-412b-bb7c-10764dea7068"). InnerVolumeSpecName "kube-api-access-pt9fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:47:24.256058 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.256042    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-dshm" (OuterVolumeSpecName: "dshm") pod "bb0359a4-5b0d-412b-bb7c-10764dea7068" (UID: "bb0359a4-5b0d-412b-bb7c-10764dea7068"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:47:24.355377 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.355300    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0359a4-5b0d-412b-bb7c-10764dea7068-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:24.355377 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.355328    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0359a4-5b0d-412b-bb7c-10764dea7068-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:24.355377 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.355339    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9fq\" (UniqueName: \"kubernetes.io/projected/bb0359a4-5b0d-412b-bb7c-10764dea7068-kube-api-access-pt9fq\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:24.434171 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.434136    2562 generic.go:356] "Generic (PLEG): container finished" podID="bb0359a4-5b0d-412b-bb7c-10764dea7068" containerID="d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a" exitCode=0
Jul 17 11:47:24.434358 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.434182    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"
Jul 17 11:47:24.434358 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.434217    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw" event={"ID":"bb0359a4-5b0d-412b-bb7c-10764dea7068","Type":"ContainerDied","Data":"d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a"}
Jul 17 11:47:24.434358 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.434262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw" event={"ID":"bb0359a4-5b0d-412b-bb7c-10764dea7068","Type":"ContainerDied","Data":"f21fbcf7d6d53865daadf4013b6a57dc2a4d58246ad09163ccb91fda5b9ec810"}
Jul 17 11:47:24.434358 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.434281    2562 scope.go:117] "RemoveContainer" containerID="d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a"
Jul 17 11:47:24.443936 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.443915    2562 scope.go:117] "RemoveContainer" containerID="d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a"
Jul 17 11:47:24.444301 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:47:24.444281    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a\": container with ID starting with d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a not found: ID does not exist" containerID="d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a"
Jul 17 11:47:24.444372 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.444310    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a"} err="failed to get container status \"d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a\": rpc error: code = NotFound desc = could not find container \"d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a\": container with ID starting with d093c6e9f3a8048760ca53cf5de14cac0fc3baad31117e5ac5277129a69bec2a not found: ID does not exist"
Jul 17 11:47:24.457913 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.457894    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"]
Jul 17 11:47:24.460034 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.460011    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bbe1d4/rate-test-model-bbe1d4-kserve-7479464f87-6mnnw"]
Jul 17 11:47:24.561068 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.561043    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:24.586208 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.586182    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7400-140359784596224_d9b81515-5883-4796-b338-04fb294bea4b/test-curl-7400-140359784596224/0.log"
Jul 17 11:47:24.618448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.618424    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:24.621784 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.621757    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:24.657701 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.657671    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfq5t\" (UniqueName: \"kubernetes.io/projected/d9b81515-5883-4796-b338-04fb294bea4b-kube-api-access-wfq5t\") pod \"d9b81515-5883-4796-b338-04fb294bea4b\" (UID: \"d9b81515-5883-4796-b338-04fb294bea4b\") "
Jul 17 11:47:24.659713 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.659693    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b81515-5883-4796-b338-04fb294bea4b-kube-api-access-wfq5t" (OuterVolumeSpecName: "kube-api-access-wfq5t") pod "d9b81515-5883-4796-b338-04fb294bea4b" (UID: "d9b81515-5883-4796-b338-04fb294bea4b"). InnerVolumeSpecName "kube-api-access-wfq5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:47:24.708161 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.708112    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt" podUID="fc27ef3e-e9ac-403b-804e-12b6a2b93559" containerName="main" containerID="cri-o://113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29" gracePeriod=45
Jul 17 11:47:24.745695 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.745663    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:24.746088 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.746060    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b81515-5883-4796-b338-04fb294bea4b" containerName="test-curl-7400-140359784596224"
Jul 17 11:47:24.746088 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.746087    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b81515-5883-4796-b338-04fb294bea4b" containerName="test-curl-7400-140359784596224"
Jul 17 11:47:24.746180 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.746114    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb0359a4-5b0d-412b-bb7c-10764dea7068" containerName="main"
Jul 17 11:47:24.746180 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.746119    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb0359a4-5b0d-412b-bb7c-10764dea7068" containerName="main"
Jul 17 11:47:24.746248 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.746185    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb0359a4-5b0d-412b-bb7c-10764dea7068" containerName="main"
Jul 17 11:47:24.746248 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.746194    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9b81515-5883-4796-b338-04fb294bea4b" containerName="test-curl-7400-140359784596224"
Jul 17 11:47:24.749194 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.749177    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:24.755377 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.755350    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:24.758663 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.758638    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfq5t\" (UniqueName: \"kubernetes.io/projected/d9b81515-5883-4796-b338-04fb294bea4b-kube-api-access-wfq5t\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:24.859464 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.859427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54m6f\" (UniqueName: \"kubernetes.io/projected/68d18a49-95ca-4e51-ac04-29848156c58f-kube-api-access-54m6f\") pod \"test-curl-7400-140359784596224\" (UID: \"68d18a49-95ca-4e51-ac04-29848156c58f\") " pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:24.955319 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.955292    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:47:24.960415 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.960394    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54m6f\" (UniqueName: \"kubernetes.io/projected/68d18a49-95ca-4e51-ac04-29848156c58f-kube-api-access-54m6f\") pod \"test-curl-7400-140359784596224\" (UID: \"68d18a49-95ca-4e51-ac04-29848156c58f\") " pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:24.970145 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:24.970123    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54m6f\" (UniqueName: \"kubernetes.io/projected/68d18a49-95ca-4e51-ac04-29848156c58f-kube-api-access-54m6f\") pod \"test-curl-7400-140359784596224\" (UID: \"68d18a49-95ca-4e51-ac04-29848156c58f\") " pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:25.061117 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061062    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ttcp\" (UniqueName: \"kubernetes.io/projected/fc27ef3e-e9ac-403b-804e-12b6a2b93559-kube-api-access-2ttcp\") pod \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") "
Jul 17 11:47:25.061299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061145    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-home\") pod \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") "
Jul 17 11:47:25.061299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-model-cache\") pod \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") "
Jul 17 11:47:25.061299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061228    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-dshm\") pod \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") "
Jul 17 11:47:25.061299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061257    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tls-certs\") pod \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") "
Jul 17 11:47:25.061299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061280    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tmp-dir\") pod \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\" (UID: \"fc27ef3e-e9ac-403b-804e-12b6a2b93559\") "
Jul 17 11:47:25.061572 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc27ef3e-e9ac-403b-804e-12b6a2b93559" (UID: "fc27ef3e-e9ac-403b-804e-12b6a2b93559"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:47:25.061572 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061443    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-home" (OuterVolumeSpecName: "home") pod "fc27ef3e-e9ac-403b-804e-12b6a2b93559" (UID: "fc27ef3e-e9ac-403b-804e-12b6a2b93559"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:47:25.061572 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061511    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-model-cache\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:25.061703 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.061582    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc27ef3e-e9ac-403b-804e-12b6a2b93559" (UID: "fc27ef3e-e9ac-403b-804e-12b6a2b93559"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:47:25.063310 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.063280    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-dshm" (OuterVolumeSpecName: "dshm") pod "fc27ef3e-e9ac-403b-804e-12b6a2b93559" (UID: "fc27ef3e-e9ac-403b-804e-12b6a2b93559"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:47:25.063421 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.063325    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc27ef3e-e9ac-403b-804e-12b6a2b93559-kube-api-access-2ttcp" (OuterVolumeSpecName: "kube-api-access-2ttcp") pod "fc27ef3e-e9ac-403b-804e-12b6a2b93559" (UID: "fc27ef3e-e9ac-403b-804e-12b6a2b93559"). InnerVolumeSpecName "kube-api-access-2ttcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:47:25.063421 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.063324    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc27ef3e-e9ac-403b-804e-12b6a2b93559" (UID: "fc27ef3e-e9ac-403b-804e-12b6a2b93559"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 11:47:25.083044 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.083020    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:25.162840 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.162800    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-home\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:25.162840 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.162831    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-dshm\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:25.162840 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.162843    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tls-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:25.163067 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.162856    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc27ef3e-e9ac-403b-804e-12b6a2b93559-tmp-dir\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:25.163067 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.162878    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ttcp\" (UniqueName: \"kubernetes.io/projected/fc27ef3e-e9ac-403b-804e-12b6a2b93559-kube-api-access-2ttcp\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:25.239931 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.239905    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:25.241687 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:47:25.241657    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68d18a49_95ca_4e51_ac04_29848156c58f.slice/crio-c80e542caf7e99c1c2d58d96e7fabff1a49d87b1d8a26e9e10e1db59c4914e47 WatchSource:0}: Error finding container c80e542caf7e99c1c2d58d96e7fabff1a49d87b1d8a26e9e10e1db59c4914e47: Status 404 returned error can't find the container with id c80e542caf7e99c1c2d58d96e7fabff1a49d87b1d8a26e9e10e1db59c4914e47
Jul 17 11:47:25.441299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.441218    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6218fdd3fcaf57cbe7289cc51676a0d7d01b199b98efabc71181bcfd05c6887f"
Jul 17 11:47:25.441299 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.441237    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:25.443486 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.443449    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7400-140359784596224" event={"ID":"68d18a49-95ca-4e51-ac04-29848156c58f","Type":"ContainerStarted","Data":"c80e542caf7e99c1c2d58d96e7fabff1a49d87b1d8a26e9e10e1db59c4914e47"}
Jul 17 11:47:25.444828 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.444802    2562 generic.go:356] "Generic (PLEG): container finished" podID="fc27ef3e-e9ac-403b-804e-12b6a2b93559" containerID="113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29" exitCode=0
Jul 17 11:47:25.444922 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.444845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt" event={"ID":"fc27ef3e-e9ac-403b-804e-12b6a2b93559","Type":"ContainerDied","Data":"113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29"}
Jul 17 11:47:25.444922 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.444852    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"
Jul 17 11:47:25.444922 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.444878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt" event={"ID":"fc27ef3e-e9ac-403b-804e-12b6a2b93559","Type":"ContainerDied","Data":"8b9b61f9b4197e40fe1a810526f1c103aae5b7e7aa45ff0c5335f82f286d5832"}
Jul 17 11:47:25.444922 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.444899    2562 scope.go:117] "RemoveContainer" containerID="113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29"
Jul 17 11:47:25.454640 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.454621    2562 scope.go:117] "RemoveContainer" containerID="113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29"
Jul 17 11:47:25.454933 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:47:25.454898    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29\": container with ID starting with 113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29 not found: ID does not exist" containerID="113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29"
Jul 17 11:47:25.455021 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.454944    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29"} err="failed to get container status \"113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29\": rpc error: code = NotFound desc = could not find container \"113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29\": container with ID starting with 113cffcb5e54b19e00608eb716b179fc40ecdbb447c7f8ad3bb2431dbd18fa29 not found: ID does not exist"
Jul 17 11:47:25.455021 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.454999    2562 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7400-140359784596224" oldPodUID="d9b81515-5883-4796-b338-04fb294bea4b" podUID="68d18a49-95ca-4e51-ac04-29848156c58f"
Jul 17 11:47:25.468869 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.468844    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"]
Jul 17 11:47:25.473221 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.473197    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7df590/rate-test-model-7df590-kserve-7d68657495-g8stt"]
Jul 17 11:47:25.680792 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.680757    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb0359a4-5b0d-412b-bb7c-10764dea7068" path="/var/lib/kubelet/pods/bb0359a4-5b0d-412b-bb7c-10764dea7068/volumes"
Jul 17 11:47:25.681111 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.681092    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9b81515-5883-4796-b338-04fb294bea4b" path="/var/lib/kubelet/pods/d9b81515-5883-4796-b338-04fb294bea4b/volumes"
Jul 17 11:47:25.681441 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:25.681429    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc27ef3e-e9ac-403b-804e-12b6a2b93559" path="/var/lib/kubelet/pods/fc27ef3e-e9ac-403b-804e-12b6a2b93559/volumes"
Jul 17 11:47:26.451361 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:26.451323    2562 generic.go:356] "Generic (PLEG): container finished" podID="68d18a49-95ca-4e51-ac04-29848156c58f" containerID="4216dfb1af39b7e39652731cf40f2023ce14212cc37febdcffe2f0154e32ccaa" exitCode=0
Jul 17 11:47:26.451772 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:26.451410    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7400-140359784596224" event={"ID":"68d18a49-95ca-4e51-ac04-29848156c58f","Type":"ContainerDied","Data":"4216dfb1af39b7e39652731cf40f2023ce14212cc37febdcffe2f0154e32ccaa"}
Jul 17 11:47:27.594910 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.594882    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:27.615231 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.615204    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7400-140359784596224_68d18a49-95ca-4e51-ac04-29848156c58f/test-curl-7400-140359784596224/0.log"
Jul 17 11:47:27.645543 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.645514    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:27.649496 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.649469    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7400-140359784596224"]
Jul 17 11:47:27.684239 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.684214    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54m6f\" (UniqueName: \"kubernetes.io/projected/68d18a49-95ca-4e51-ac04-29848156c58f-kube-api-access-54m6f\") pod \"68d18a49-95ca-4e51-ac04-29848156c58f\" (UID: \"68d18a49-95ca-4e51-ac04-29848156c58f\") "
Jul 17 11:47:27.686216 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.686191    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68d18a49-95ca-4e51-ac04-29848156c58f-kube-api-access-54m6f" (OuterVolumeSpecName: "kube-api-access-54m6f") pod "68d18a49-95ca-4e51-ac04-29848156c58f" (UID: "68d18a49-95ca-4e51-ac04-29848156c58f"). InnerVolumeSpecName "kube-api-access-54m6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:47:27.785283 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.785201    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54m6f\" (UniqueName: \"kubernetes.io/projected/68d18a49-95ca-4e51-ac04-29848156c58f-kube-api-access-54m6f\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:27.855941 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.855907    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"]
Jul 17 11:47:27.856289 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.856276    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc27ef3e-e9ac-403b-804e-12b6a2b93559" containerName="main"
Jul 17 11:47:27.856339 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.856292    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc27ef3e-e9ac-403b-804e-12b6a2b93559" containerName="main"
Jul 17 11:47:27.856339 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.856307    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68d18a49-95ca-4e51-ac04-29848156c58f" containerName="test-curl-7400-140359784596224"
Jul 17 11:47:27.856339 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.856313    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="68d18a49-95ca-4e51-ac04-29848156c58f" containerName="test-curl-7400-140359784596224"
Jul 17 11:47:27.856431 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.856387    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc27ef3e-e9ac-403b-804e-12b6a2b93559" containerName="main"
Jul 17 11:47:27.856431 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.856395    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="68d18a49-95ca-4e51-ac04-29848156c58f" containerName="test-curl-7400-140359784596224"
Jul 17 11:47:27.859390 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.859375    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"
Jul 17 11:47:27.861687 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.861667    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:47:27.861802 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.861761    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:47:27.867029 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.867008    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"]
Jul 17 11:47:27.987062 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:27.987024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/715e65ea-6218-43f0-8eb7-60aefcbc5990-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v\" (UID: \"715e65ea-6218-43f0-8eb7-60aefcbc5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"
Jul 17 11:47:28.088311 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:28.088231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/715e65ea-6218-43f0-8eb7-60aefcbc5990-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v\" (UID: \"715e65ea-6218-43f0-8eb7-60aefcbc5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"
Jul 17 11:47:28.088842 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:28.088823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/715e65ea-6218-43f0-8eb7-60aefcbc5990-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v\" (UID: \"715e65ea-6218-43f0-8eb7-60aefcbc5990\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"
Jul 17 11:47:28.170341 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:28.170307    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"
Jul 17 11:47:28.316712 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:28.316679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"]
Jul 17 11:47:28.319247 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:47:28.319215    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715e65ea_6218_43f0_8eb7_60aefcbc5990.slice/crio-101e33c91f15c5df36a28e62970874382bd1598413d153359d105548a4f004c3 WatchSource:0}: Error finding container 101e33c91f15c5df36a28e62970874382bd1598413d153359d105548a4f004c3: Status 404 returned error can't find the container with id 101e33c91f15c5df36a28e62970874382bd1598413d153359d105548a4f004c3
Jul 17 11:47:28.427063 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:28.427028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:28.463398 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:28.463375    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7400-140359784596224"
Jul 17 11:47:28.463398 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:28.463385    2562 scope.go:117] "RemoveContainer" containerID="4216dfb1af39b7e39652731cf40f2023ce14212cc37febdcffe2f0154e32ccaa"
Jul 17 11:47:28.464843 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:28.464817    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v" event={"ID":"715e65ea-6218-43f0-8eb7-60aefcbc5990","Type":"ContainerStarted","Data":"101e33c91f15c5df36a28e62970874382bd1598413d153359d105548a4f004c3"}
Jul 17 11:47:29.475000 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:29.474965    2562 generic.go:356] "Generic (PLEG): container finished" podID="715e65ea-6218-43f0-8eb7-60aefcbc5990" containerID="539d5fa1c479196768aa096e788479fec7b9bfe0fdbf5365dd3b5dad11f1ed7c" exitCode=0
Jul 17 11:47:29.475426 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:29.475021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v" event={"ID":"715e65ea-6218-43f0-8eb7-60aefcbc5990","Type":"ContainerDied","Data":"539d5fa1c479196768aa096e788479fec7b9bfe0fdbf5365dd3b5dad11f1ed7c"}
Jul 17 11:47:29.682139 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:29.682107    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68d18a49-95ca-4e51-ac04-29848156c58f" path="/var/lib/kubelet/pods/68d18a49-95ca-4e51-ac04-29848156c58f/volumes"
Jul 17 11:47:29.793760 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:29.793669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:30.613455 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:30.613433    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"
Jul 17 11:47:30.713325 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:30.713294    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/715e65ea-6218-43f0-8eb7-60aefcbc5990-maas-api-service-ca\") pod \"715e65ea-6218-43f0-8eb7-60aefcbc5990\" (UID: \"715e65ea-6218-43f0-8eb7-60aefcbc5990\") "
Jul 17 11:47:30.713634 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:30.713614    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/715e65ea-6218-43f0-8eb7-60aefcbc5990-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "715e65ea-6218-43f0-8eb7-60aefcbc5990" (UID: "715e65ea-6218-43f0-8eb7-60aefcbc5990"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:47:30.814310 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:30.813998    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/715e65ea-6218-43f0-8eb7-60aefcbc5990-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:31.488310 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:31.488284    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v"
Jul 17 11:47:31.488310 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:31.488309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v" event={"ID":"715e65ea-6218-43f0-8eb7-60aefcbc5990","Type":"ContainerDied","Data":"101e33c91f15c5df36a28e62970874382bd1598413d153359d105548a4f004c3"}
Jul 17 11:47:31.488523 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:31.488350    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="101e33c91f15c5df36a28e62970874382bd1598413d153359d105548a4f004c3"
Jul 17 11:47:39.242622 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:39.242592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:42.965595 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:42.965560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:48.933263 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:48.933223    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:49.008961 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:49.008928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:53.677963 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:53.677930    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:53.913537 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:53.913502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:54.039687 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.039602    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"]
Jul 17 11:47:54.039969 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.039958    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="715e65ea-6218-43f0-8eb7-60aefcbc5990" containerName="revoke-keys"
Jul 17 11:47:54.040019 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.039971    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="715e65ea-6218-43f0-8eb7-60aefcbc5990" containerName="revoke-keys"
Jul 17 11:47:54.040054 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.040046    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="715e65ea-6218-43f0-8eb7-60aefcbc5990" containerName="revoke-keys"
Jul 17 11:47:54.043334 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.043318    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"
Jul 17 11:47:54.045929 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.045910    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 11:47:54.045992 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.045926    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-87tmr\""
Jul 17 11:47:54.050992 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.050773    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"]
Jul 17 11:47:54.234855 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.234818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06d8e36-ced3-47a6-a0e4-b99672d29665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t\" (UID: \"a06d8e36-ced3-47a6-a0e4-b99672d29665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"
Jul 17 11:47:54.336358 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.336265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06d8e36-ced3-47a6-a0e4-b99672d29665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t\" (UID: \"a06d8e36-ced3-47a6-a0e4-b99672d29665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"
Jul 17 11:47:54.336938 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.336901    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06d8e36-ced3-47a6-a0e4-b99672d29665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t\" (UID: \"a06d8e36-ced3-47a6-a0e4-b99672d29665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"
Jul 17 11:47:54.355194 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.355163    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"
Jul 17 11:47:54.486430 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.486405    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"]
Jul 17 11:47:54.489360 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:47:54.489337    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda06d8e36_ced3_47a6_a0e4_b99672d29665.slice/crio-c8a7201b8d945456bd3666833ed25a43f787e641b6ff27acd107d5283a6ddad7 WatchSource:0}: Error finding container c8a7201b8d945456bd3666833ed25a43f787e641b6ff27acd107d5283a6ddad7: Status 404 returned error can't find the container with id c8a7201b8d945456bd3666833ed25a43f787e641b6ff27acd107d5283a6ddad7
Jul 17 11:47:54.607149 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.607056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t" event={"ID":"a06d8e36-ced3-47a6-a0e4-b99672d29665","Type":"ContainerStarted","Data":"c8a7201b8d945456bd3666833ed25a43f787e641b6ff27acd107d5283a6ddad7"}
Jul 17 11:47:54.676480 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.676449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:54.772259 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:54.772230    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:47:55.613862 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:55.613830    2562 generic.go:356] "Generic (PLEG): container finished" podID="a06d8e36-ced3-47a6-a0e4-b99672d29665" containerID="75e93776614cd4d4714765221f1be0670f41b494f2c6371aec5dfd82d9fc615c" exitCode=0
Jul 17 11:47:55.614039 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:55.613897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t" event={"ID":"a06d8e36-ced3-47a6-a0e4-b99672d29665","Type":"ContainerDied","Data":"75e93776614cd4d4714765221f1be0670f41b494f2c6371aec5dfd82d9fc615c"}
Jul 17 11:47:56.756693 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:56.756671    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"
Jul 17 11:47:56.854819 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:56.854788    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06d8e36-ced3-47a6-a0e4-b99672d29665-maas-api-service-ca\") pod \"a06d8e36-ced3-47a6-a0e4-b99672d29665\" (UID: \"a06d8e36-ced3-47a6-a0e4-b99672d29665\") "
Jul 17 11:47:56.855216 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:56.855196    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a06d8e36-ced3-47a6-a0e4-b99672d29665-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a06d8e36-ced3-47a6-a0e4-b99672d29665" (UID: "a06d8e36-ced3-47a6-a0e4-b99672d29665"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:47:56.956027 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:56.955938    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a06d8e36-ced3-47a6-a0e4-b99672d29665-maas-api-service-ca\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:47:57.624151 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:57.624122    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t"
Jul 17 11:47:57.624322 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:57.624121    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t" event={"ID":"a06d8e36-ced3-47a6-a0e4-b99672d29665","Type":"ContainerDied","Data":"c8a7201b8d945456bd3666833ed25a43f787e641b6ff27acd107d5283a6ddad7"}
Jul 17 11:47:57.624322 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:47:57.624268    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8a7201b8d945456bd3666833ed25a43f787e641b6ff27acd107d5283a6ddad7"
Jul 17 11:48:03.221150 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:03.221043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:04.494479 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:04.494442    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:07.782061 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:07.782023    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:07.842090 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:07.842041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:09.144492 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:09.144459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:15.002294 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:15.002261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:15.096311 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:15.096281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:19.831259 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:19.831227    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"]
Jul 17 11:48:19.831690 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:19.831436    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy" containerID="cri-o://9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124" gracePeriod=30
Jul 17 11:48:19.859752 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:19.859723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:20.085771 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:20.085684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:20.489855 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:20.489821    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f7b68cbd6-vj8z4_96af127d-65b3-4cc5-9aa7-869689f0549c/authorino/0.log"
Jul 17 11:48:25.086095 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.086047    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:48:25.216474 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216438    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-token\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.216653 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216480    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-certs\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.216653 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216513    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-podinfo\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.216653 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216529    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-data\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.216788 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216658    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-credential-socket\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.216788 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216700    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8950e84-1258-4f6a-8045-22fa0d65871d-istiod-ca-cert\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.216788 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216769    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-socket\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.216943 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216810    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:48:25.216943 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216853    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-envoy\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.216943 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216886    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlpbd\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-kube-api-access-jlpbd\") pod \"d8950e84-1258-4f6a-8045-22fa0d65871d\" (UID: \"d8950e84-1258-4f6a-8045-22fa0d65871d\") "
Jul 17 11:48:25.217139 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.216950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:48:25.217139 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.217049    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:48:25.217259 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.217172    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8950e84-1258-4f6a-8045-22fa0d65871d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 11:48:25.217307 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.217282    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-certs\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.217307 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.217302    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-credential-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.217409 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.217317    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8950e84-1258-4f6a-8045-22fa0d65871d-istiod-ca-cert\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.217409 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.217330    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-workload-socket\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.217659 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.217632    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:48:25.218684 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.218652    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:48:25.218802 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.218750    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 11:48:25.218926 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.218909    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 11:48:25.219014 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.218999    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-kube-api-access-jlpbd" (OuterVolumeSpecName: "kube-api-access-jlpbd") pod "d8950e84-1258-4f6a-8045-22fa0d65871d" (UID: "d8950e84-1258-4f6a-8045-22fa0d65871d"). InnerVolumeSpecName "kube-api-access-jlpbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 11:48:25.317794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.317753    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-envoy\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.317794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.317785    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlpbd\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-kube-api-access-jlpbd\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.317794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.317795    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-token\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.317794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.317803    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-podinfo\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.318048 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.317811    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8950e84-1258-4f6a-8045-22fa0d65871d-istio-data\") on node \"ip-10-0-131-178.ec2.internal\" DevicePath \"\""
Jul 17 11:48:25.758301 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.758268    2562 generic.go:356] "Generic (PLEG): container finished" podID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerID="9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124" exitCode=0
Jul 17 11:48:25.758493 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.758314    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"
Jul 17 11:48:25.758493 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.758326    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" event={"ID":"d8950e84-1258-4f6a-8045-22fa0d65871d","Type":"ContainerDied","Data":"9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124"}
Jul 17 11:48:25.758493 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.758367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg" event={"ID":"d8950e84-1258-4f6a-8045-22fa0d65871d","Type":"ContainerDied","Data":"ee263d5122d23d130c7f9ce21b917d5eae310af3120f74195fe9c92d9b36ad4e"}
Jul 17 11:48:25.758493 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.758388    2562 scope.go:117] "RemoveContainer" containerID="9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124"
Jul 17 11:48:25.773255 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.773226    2562 scope.go:117] "RemoveContainer" containerID="6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c"
Jul 17 11:48:25.781400 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.781376    2562 scope.go:117] "RemoveContainer" containerID="9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124"
Jul 17 11:48:25.781654 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:48:25.781633    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124\": container with ID starting with 9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124 not found: ID does not exist" containerID="9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124"
Jul 17 11:48:25.781737 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.781665    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124"} err="failed to get container status \"9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124\": rpc error: code = NotFound desc = could not find container \"9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124\": container with ID starting with 9b076847e97dc95b5f47251a86cae55354860136208e003ef293c5c2265a8124 not found: ID does not exist"
Jul 17 11:48:25.781737 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.781688    2562 scope.go:117] "RemoveContainer" containerID="6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c"
Jul 17 11:48:25.781934 ip-10-0-131-178 kubenswrapper[2562]: E0717 11:48:25.781915    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c\": container with ID starting with 6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c not found: ID does not exist" containerID="6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c"
Jul 17 11:48:25.781992 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.781939    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c"} err="failed to get container status \"6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c\": rpc error: code = NotFound desc = could not find container \"6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c\": container with ID starting with 6be3f78c4026120f0970d8c4c2f82256f2c917d8f0089d41501c9cea7d460e1c not found: ID does not exist"
Jul 17 11:48:25.785263 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.785242    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"]
Jul 17 11:48:25.794150 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:25.794129    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-7df590-openshift-default-d55df4f75-fqmmg"]
Jul 17 11:48:26.429998 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:26.429972    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qwpht_7d746b3c-315f-4491-ac00-27c89b9a6a4d/manager/0.log"
Jul 17 11:48:26.806866 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:26.806792    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m_65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda/copy-manifests/0.log"
Jul 17 11:48:26.814248 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:26.814226    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m_65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda/manager/0.log"
Jul 17 11:48:27.297280 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:27.297250    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738115-xndtt_ee2afdf2-fa38-4aa1-b580-f17fdd9a37a8/cleanup/0.log"
Jul 17 11:48:27.407539 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:27.407514    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29738130-rq8ds_c6573ade-e5b3-4e83-af80-3d585fc0b25e/cleanup/0.log"
Jul 17 11:48:27.628016 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:27.627993    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-02cb6e-hrqfs_cbe9d11c-afa9-407d-a3fe-0e03a6027e24/revoke-keys/0.log"
Jul 17 11:48:27.680912 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:27.680884    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" path="/var/lib/kubelet/pods/d8950e84-1258-4f6a-8045-22fa0d65871d/volumes"
Jul 17 11:48:27.744494 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:27.744468    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-42637c-xvr7g_e9127735-cf87-48dd-94bf-46b6df3fa199/revoke-keys/0.log"
Jul 17 11:48:27.965946 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:27.965852    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-b18220-54jlm_b76ccc53-37c2-405e-aeef-8e2268c99e96/revoke-keys/0.log"
Jul 17 11:48:28.298630 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:28.298525    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-bbe1d4-sfp6v_715e65ea-6218-43f0-8eb7-60aefcbc5990/revoke-keys/0.log"
Jul 17 11:48:28.411850 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:28.411813    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-7df590-t9q5t_a06d8e36-ced3-47a6-a0e4-b99672d29665/revoke-keys/0.log"
Jul 17 11:48:29.851388 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:29.851337    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f7b68cbd6-vj8z4_96af127d-65b3-4cc5-9aa7-869689f0549c/authorino/0.log"
Jul 17 11:48:31.053529 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:31.053498    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678t8v7l_7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54/istio-proxy/0.log"
Jul 17 11:48:31.411345 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:31.411274    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5445b9658d-sgn5m_6a0540d2-666f-4247-95db-81c3c5605111/kube-auth-proxy/0.log"
Jul 17 11:48:31.901342 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:31.901318    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d856bb68d-fzsgp_4092b03a-662e-421e-9019-2df165983d93/router/0.log"
Jul 17 11:48:32.590926 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:32.590897    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbf5f2f_72223501-fa38-4bde-96df-5371402de82d/main/0.log"
Jul 17 11:48:32.819715 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:32.819682    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-ww57r_8c02a705-e17f-4a38-984a-95925fa9315b/main/0.log"
Jul 17 11:48:38.196051 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196014    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m29nl/must-gather-48vmp"]
Jul 17 11:48:38.196448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196385    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a06d8e36-ced3-47a6-a0e4-b99672d29665" containerName="revoke-keys"
Jul 17 11:48:38.196448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196397    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a06d8e36-ced3-47a6-a0e4-b99672d29665" containerName="revoke-keys"
Jul 17 11:48:38.196448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196413    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy"
Jul 17 11:48:38.196448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196419    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy"
Jul 17 11:48:38.196448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196436    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy"
Jul 17 11:48:38.196448 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196441    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy"
Jul 17 11:48:38.196638 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196494    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy"
Jul 17 11:48:38.196638 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196503    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8950e84-1258-4f6a-8045-22fa0d65871d" containerName="istio-proxy"
Jul 17 11:48:38.196638 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.196512    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a06d8e36-ced3-47a6-a0e4-b99672d29665" containerName="revoke-keys"
Jul 17 11:48:38.201433 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.201412    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m29nl/must-gather-48vmp"
Jul 17 11:48:38.204438 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.204405    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m29nl\"/\"default-dockercfg-gjkbp\""
Jul 17 11:48:38.204695 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.204675    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m29nl\"/\"openshift-service-ca.crt\""
Jul 17 11:48:38.205404 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.205372    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m29nl\"/\"kube-root-ca.crt\""
Jul 17 11:48:38.205743 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.205719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:38.210794 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.210771    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m29nl/must-gather-48vmp"]
Jul 17 11:48:38.281213 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.281171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log" limit=1024
Jul 17 11:48:38.326541 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.326510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7pb\" (UniqueName: \"kubernetes.io/projected/42c38a5f-5f9c-4f35-bdc3-efc047ac9142-kube-api-access-ht7pb\") pod \"must-gather-48vmp\" (UID: \"42c38a5f-5f9c-4f35-bdc3-efc047ac9142\") " pod="openshift-must-gather-m29nl/must-gather-48vmp"
Jul 17 11:48:38.326658 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.326585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42c38a5f-5f9c-4f35-bdc3-efc047ac9142-must-gather-output\") pod \"must-gather-48vmp\" (UID: \"42c38a5f-5f9c-4f35-bdc3-efc047ac9142\") " pod="openshift-must-gather-m29nl/must-gather-48vmp"
Jul 17 11:48:38.427326 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.427279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7pb\" (UniqueName: \"kubernetes.io/projected/42c38a5f-5f9c-4f35-bdc3-efc047ac9142-kube-api-access-ht7pb\") pod \"must-gather-48vmp\" (UID: \"42c38a5f-5f9c-4f35-bdc3-efc047ac9142\") " pod="openshift-must-gather-m29nl/must-gather-48vmp"
Jul 17 11:48:38.427490 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.427375    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42c38a5f-5f9c-4f35-bdc3-efc047ac9142-must-gather-output\") pod \"must-gather-48vmp\" (UID: \"42c38a5f-5f9c-4f35-bdc3-efc047ac9142\") " pod="openshift-must-gather-m29nl/must-gather-48vmp"
Jul 17 11:48:38.427709 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.427692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/42c38a5f-5f9c-4f35-bdc3-efc047ac9142-must-gather-output\") pod \"must-gather-48vmp\" (UID: \"42c38a5f-5f9c-4f35-bdc3-efc047ac9142\") " pod="openshift-must-gather-m29nl/must-gather-48vmp"
Jul 17 11:48:38.436255 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.436229    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7pb\" (UniqueName: \"kubernetes.io/projected/42c38a5f-5f9c-4f35-bdc3-efc047ac9142-kube-api-access-ht7pb\") pod \"must-gather-48vmp\" (UID: \"42c38a5f-5f9c-4f35-bdc3-efc047ac9142\") " pod="openshift-must-gather-m29nl/must-gather-48vmp"
Jul 17 11:48:38.512054 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.511989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m29nl/must-gather-48vmp"
Jul 17 11:48:38.645483 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.645451    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m29nl/must-gather-48vmp"]
Jul 17 11:48:38.647214 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:48:38.647186    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42c38a5f_5f9c_4f35_bdc3_efc047ac9142.slice/crio-8011919c94a539eafdfe1816f96d7c6d978b4f5255ce8b42b0375f79bf27a886 WatchSource:0}: Error finding container 8011919c94a539eafdfe1816f96d7c6d978b4f5255ce8b42b0375f79bf27a886: Status 404 returned error can't find the container with id 8011919c94a539eafdfe1816f96d7c6d978b4f5255ce8b42b0375f79bf27a886
Jul 17 11:48:38.825611 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:38.825529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m29nl/must-gather-48vmp" event={"ID":"42c38a5f-5f9c-4f35-bdc3-efc047ac9142","Type":"ContainerStarted","Data":"8011919c94a539eafdfe1816f96d7c6d978b4f5255ce8b42b0375f79bf27a886"}
Jul 17 11:48:39.836754 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:39.836706    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m29nl/must-gather-48vmp" event={"ID":"42c38a5f-5f9c-4f35-bdc3-efc047ac9142","Type":"ContainerStarted","Data":"4c183ab139fb5437fc29bda9761b4d2d65c392df58aadbdbd1d09bb2f6eb5906"}
Jul 17 11:48:39.837141 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:39.836772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m29nl/must-gather-48vmp" event={"ID":"42c38a5f-5f9c-4f35-bdc3-efc047ac9142","Type":"ContainerStarted","Data":"253efbf1f4f6e62a0e6d836a33464ccdcbe89032a24686c11ab64513c719d7f7"}
Jul 17 11:48:39.855070 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:39.854961    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m29nl/must-gather-48vmp" podStartSLOduration=0.900825713 podStartE2EDuration="1.85494019s" totalImagesPullingTime="954.114477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 11:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:48:39.853784075 +0000 UTC m=+3360.658809561" watchObservedRunningTime="2026-07-17 11:48:39.85494019 +0000 UTC m=+3360.659965676"
Jul 17 11:48:41.287115 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:41.287068    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zlghh_72fcfdbb-219f-4e6a-b74b-001dfd0b2ac9/global-pull-secret-syncer/0.log"
Jul 17 11:48:41.336805 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:41.336772    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9k72q_5c39e53a-22b1-488f-9327-4acaa2c3c3ab/konnectivity-agent/0.log"
Jul 17 11:48:41.447009 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:41.446975    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-178.ec2.internal_acc6d4e274b58fd0b6a9631751aad296/haproxy/0.log"
Jul 17 11:48:46.805105 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:46.804627    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f7b68cbd6-vj8z4_96af127d-65b3-4cc5-9aa7-869689f0549c/authorino/0.log"
Jul 17 11:48:49.033322 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.033281    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_100c4d58-1261-4d89-9232-dcfc41f01a00/alertmanager/0.log"
Jul 17 11:48:49.054025 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.053994    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_100c4d58-1261-4d89-9232-dcfc41f01a00/config-reloader/0.log"
Jul 17 11:48:49.079501 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.079467    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_100c4d58-1261-4d89-9232-dcfc41f01a00/kube-rbac-proxy-web/0.log"
Jul 17 11:48:49.105719 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.105644    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_100c4d58-1261-4d89-9232-dcfc41f01a00/kube-rbac-proxy/0.log"
Jul 17 11:48:49.128726 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.128692    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_100c4d58-1261-4d89-9232-dcfc41f01a00/kube-rbac-proxy-metric/0.log"
Jul 17 11:48:49.150325 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.150300    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_100c4d58-1261-4d89-9232-dcfc41f01a00/prom-label-proxy/0.log"
Jul 17 11:48:49.170748 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.170719    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_100c4d58-1261-4d89-9232-dcfc41f01a00/init-config-reloader/0.log"
Jul 17 11:48:49.257150 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.257121    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gdhrq_13c835de-51e0-49db-b385-450d506822c3/kube-state-metrics/0.log"
Jul 17 11:48:49.277647 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.277618    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gdhrq_13c835de-51e0-49db-b385-450d506822c3/kube-rbac-proxy-main/0.log"
Jul 17 11:48:49.303113 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.303067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-gdhrq_13c835de-51e0-49db-b385-450d506822c3/kube-rbac-proxy-self/0.log"
Jul 17 11:48:49.330892 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.330852    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b89df7fd4-4mv5p_29df68e3-c959-43a3-a4c4-003925146956/metrics-server/0.log"
Jul 17 11:48:49.547220 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.547185    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ng2jw_7812efd6-a9a7-45e4-808b-8e015b74a664/node-exporter/0.log"
Jul 17 11:48:49.573774 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.573728    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ng2jw_7812efd6-a9a7-45e4-808b-8e015b74a664/kube-rbac-proxy/0.log"
Jul 17 11:48:49.600313 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.600283    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ng2jw_7812efd6-a9a7-45e4-808b-8e015b74a664/init-textfile/0.log"
Jul 17 11:48:49.636735 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.636677    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wvbfv_8b142691-4915-4797-9311-7d7f6d7f360f/kube-rbac-proxy-main/0.log"
Jul 17 11:48:49.660740 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.660685    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wvbfv_8b142691-4915-4797-9311-7d7f6d7f360f/kube-rbac-proxy-self/0.log"
Jul 17 11:48:49.683657 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.683618    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wvbfv_8b142691-4915-4797-9311-7d7f6d7f360f/openshift-state-metrics/0.log"
Jul 17 11:48:49.996498 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:49.996470    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddcb5f5b4-f64zc_925cf275-c7cd-47d1-b498-565c27a85ba7/telemeter-client/0.log"
Jul 17 11:48:50.017144 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:50.017116    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddcb5f5b4-f64zc_925cf275-c7cd-47d1-b498-565c27a85ba7/reload/0.log"
Jul 17 11:48:50.038758 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:50.038729    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5ddcb5f5b4-f64zc_925cf275-c7cd-47d1-b498-565c27a85ba7/kube-rbac-proxy/0.log"
Jul 17 11:48:51.385904 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.385864    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-5b4hs_45c2ff42-0514-40fd-a7fc-c8c1d5bf6e8d/networking-console-plugin/0.log"
Jul 17 11:48:51.461807 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.461768    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"]
Jul 17 11:48:51.468829 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.468797    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.485247 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.485212    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"]
Jul 17 11:48:51.576782 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.576734    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-sys\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.576963 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.576841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-proc\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.576963 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.576926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-lib-modules\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.577093 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.576964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs2nn\" (UniqueName: \"kubernetes.io/projected/71eb57cf-9093-4dcf-8f7b-302456362e07-kube-api-access-vs2nn\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.577149 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.577110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-podres\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678319 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-sys\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678597 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-proc\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678597 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-proc\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678597 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-sys\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678597 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-lib-modules\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678597 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs2nn\" (UniqueName: \"kubernetes.io/projected/71eb57cf-9093-4dcf-8f7b-302456362e07-kube-api-access-vs2nn\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678597 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-podres\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678597 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-lib-modules\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.678919 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.678687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71eb57cf-9093-4dcf-8f7b-302456362e07-podres\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.689016 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.688988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs2nn\" (UniqueName: \"kubernetes.io/projected/71eb57cf-9093-4dcf-8f7b-302456362e07-kube-api-access-vs2nn\") pod \"perf-node-gather-daemonset-m2w4z\" (UID: \"71eb57cf-9093-4dcf-8f7b-302456362e07\") " pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.782352 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.782309    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:51.957632 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:51.957550    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"]
Jul 17 11:48:51.961567 ip-10-0-131-178 kubenswrapper[2562]: W0717 11:48:51.961529    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod71eb57cf_9093_4dcf_8f7b_302456362e07.slice/crio-703df7babd6c7bf6f3e7a6672f997a44e429e71c9d86340911f722357063151a WatchSource:0}: Error finding container 703df7babd6c7bf6f3e7a6672f997a44e429e71c9d86340911f722357063151a: Status 404 returned error can't find the container with id 703df7babd6c7bf6f3e7a6672f997a44e429e71c9d86340911f722357063151a
Jul 17 11:48:52.530599 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:52.530529    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-6n64x_b7a699db-cf90-4f66-b2dc-439565f827af/download-server/0.log"
Jul 17 11:48:52.932915 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:52.932865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z" event={"ID":"71eb57cf-9093-4dcf-8f7b-302456362e07","Type":"ContainerStarted","Data":"229d631eee4fbe411c738a155a25a091aeae09bde7b20650176d4d822118a0b9"}
Jul 17 11:48:52.933107 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:52.932935    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z" event={"ID":"71eb57cf-9093-4dcf-8f7b-302456362e07","Type":"ContainerStarted","Data":"703df7babd6c7bf6f3e7a6672f997a44e429e71c9d86340911f722357063151a"}
Jul 17 11:48:52.933107 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:52.932965    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:48:52.953066 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:52.953012    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z" podStartSLOduration=1.952997725 podStartE2EDuration="1.952997725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 11:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 11:48:52.951240944 +0000 UTC m=+3373.756266430" watchObservedRunningTime="2026-07-17 11:48:52.952997725 +0000 UTC m=+3373.758023210"
Jul 17 11:48:53.081025 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:53.080999    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-wh549_c1a77a08-6c69-4e24-a666-f449f4da88d9/volume-data-source-validator/0.log"
Jul 17 11:48:54.182344 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:54.182319    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r999n_7b648385-a42a-440a-b7ab-3246ec144bb5/dns/0.log"
Jul 17 11:48:54.202166 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:54.202136    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r999n_7b648385-a42a-440a-b7ab-3246ec144bb5/kube-rbac-proxy/0.log"
Jul 17 11:48:54.246690 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:54.246660    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qr4cc_0286f029-cca9-4df3-a452-b11e80f99247/dns-node-resolver/0.log"
Jul 17 11:48:54.786825 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:54.786780    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c6498b876-vhstv_fc995f87-1c7a-4aa7-a680-683b9cace3e1/registry/0.log"
Jul 17 11:48:54.809350 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:54.809319    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7hsm8_56c2b59f-ee0b-4bb6-904b-67cd4de9ea38/node-ca/0.log"
Jul 17 11:48:55.792056 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:55.791986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678t8v7l_7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54/istio-proxy/0.log"
Jul 17 11:48:56.054854 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:56.054778    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5445b9658d-sgn5m_6a0540d2-666f-4247-95db-81c3c5605111/kube-auth-proxy/0.log"
Jul 17 11:48:56.254894 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:56.254862    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d856bb68d-fzsgp_4092b03a-662e-421e-9019-2df165983d93/router/0.log"
Jul 17 11:48:56.919348 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:56.919261    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9zdmf_ea1309d4-ee58-4f0e-8fa0-cb139ca57d2c/serve-healthcheck-canary/0.log"
Jul 17 11:48:57.676550 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:57.676522    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzcrj_c5fc8261-c3e3-4167-93cb-a2184dcc1604/kube-rbac-proxy/0.log"
Jul 17 11:48:57.704263 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:57.704213    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzcrj_c5fc8261-c3e3-4167-93cb-a2184dcc1604/exporter/0.log"
Jul 17 11:48:57.733724 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:57.733692    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hzcrj_c5fc8261-c3e3-4167-93cb-a2184dcc1604/extractor/0.log"
Jul 17 11:48:58.952644 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:48:58.952618    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m29nl/perf-node-gather-daemonset-m2w4z"
Jul 17 11:49:00.339305 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:00.339194    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qwpht_7d746b3c-315f-4491-ac00-27c89b9a6a4d/manager/0.log"
Jul 17 11:49:00.583670 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:00.583630    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m_65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda/manager/0.log"
Jul 17 11:49:00.613178 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:00.613147    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68f7bbb6f9-q4p6m_65bab7a9-bf7c-461e-b7ff-3a9a30ae0fda/copy-manifests/0.log"
Jul 17 11:49:01.261239 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:01.261167    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678t8v7l_7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54/istio-proxy/0.log"
Jul 17 11:49:01.500930 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:01.500854    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5445b9658d-sgn5m_6a0540d2-666f-4247-95db-81c3c5605111/kube-auth-proxy/0.log"
Jul 17 11:49:01.653093 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:01.653046    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d856bb68d-fzsgp_4092b03a-662e-421e-9019-2df165983d93/router/0.log"
Jul 17 11:49:01.945049 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:01.945019    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9895988c6-5kcbl_1d83f22c-fb0d-47a0-80af-c0ebc822a39c/manager/0.log"
Jul 17 11:49:02.802815 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:02.802784    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678t8v7l_7b53c4fe-a852-4a1d-ad21-b25cfdcc8d54/istio-proxy/0.log"
Jul 17 11:49:03.039157 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:03.039067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5445b9658d-sgn5m_6a0540d2-666f-4247-95db-81c3c5605111/kube-auth-proxy/0.log"
Jul 17 11:49:03.215888 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:03.215860    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d856bb68d-fzsgp_4092b03a-662e-421e-9019-2df165983d93/router/0.log"
Jul 17 11:49:06.818039 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:06.817989    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-7sf9p_4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d/migrator/0.log"
Jul 17 11:49:06.846495 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:06.846469    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-7sf9p_4f89c1ff-2d49-437a-9d7d-2e5de8f1d88d/graceful-termination/0.log"
Jul 17 11:49:07.198672 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:07.198635    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-4gkhz_8d300558-5661-4046-9a61-426b79e18bac/kube-storage-version-migrator-operator/1.log"
Jul 17 11:49:07.199667 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:07.199647    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-4gkhz_8d300558-5661-4046-9a61-426b79e18bac/kube-storage-version-migrator-operator/0.log"
Jul 17 11:49:08.354334 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:08.354259    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbjl7_475bd173-f49b-4583-a4ca-258543fe2ef9/kube-multus-additional-cni-plugins/0.log"
Jul 17 11:49:08.376820 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:08.376795    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbjl7_475bd173-f49b-4583-a4ca-258543fe2ef9/egress-router-binary-copy/0.log"
Jul 17 11:49:08.395791 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:08.395765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbjl7_475bd173-f49b-4583-a4ca-258543fe2ef9/cni-plugins/0.log"
Jul 17 11:49:08.415362 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:08.415339    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbjl7_475bd173-f49b-4583-a4ca-258543fe2ef9/bond-cni-plugin/0.log"
Jul 17 11:49:08.435991 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:08.435955    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbjl7_475bd173-f49b-4583-a4ca-258543fe2ef9/routeoverride-cni/0.log"
Jul 17 11:49:08.457086 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:08.457017    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbjl7_475bd173-f49b-4583-a4ca-258543fe2ef9/whereabouts-cni-bincopy/0.log"
Jul 17 11:49:08.479937 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:08.479904    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbjl7_475bd173-f49b-4583-a4ca-258543fe2ef9/whereabouts-cni/0.log"
Jul 17 11:49:08.678334 ip-10-0-131-178 kubenswrapper[2562]: I0717 11:49:08.678297    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-m6drf_55b11b39-b9f4-43b5-83dd-342bc197da0f/kube-multus/0.log"