Jul 29 00:07:47.042457 ip-10-0-131-68 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 00:07:47.507722 ip-10-0-131-68 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 00:07:47.507722 ip-10-0-131-68 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 00:07:47.507722 ip-10-0-131-68 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 00:07:47.507722 ip-10-0-131-68 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 00:07:47.507722 ip-10-0-131-68 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 00:07:47.508872 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.508789    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 00:07:47.513720 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513697    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:07:47.513720 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513720    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:07:47.513720 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513723    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:07:47.513720 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513727    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:07:47.513720 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513730    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:07:47.513720 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513733    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513735    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513738    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513740    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513743    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513745    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513748    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513754    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513757    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513761    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513763    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513766    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513768    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513771    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513775    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513779    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513782    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513785    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513788    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:07:47.513892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513791    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513794    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513797    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513800    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513802    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513805    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513808    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513810    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513813    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513816    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513819    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513822    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513824    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513828    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513832    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513835    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513837    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513840    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513842    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513845    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:07:47.514351 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513847    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513850    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513852    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513856    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513860    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513863    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513867    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513870    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513873    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513876    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513879    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513881    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513884    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513886    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513889    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513892    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513894    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513897    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513900    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:07:47.514829 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513903    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513905    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513908    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513911    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513913    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513916    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513918    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513921    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513924    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513927    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513929    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513932    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513934    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513937    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513941    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513943    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513946    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513948    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513951    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:07:47.515298 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513953    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513956    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513958    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513960    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513963    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513965    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513968    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513970    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513972    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513975    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513977    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513980    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513982    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513985    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513987    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513989    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.513992    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514743    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514751    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:07:47.515743 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514755    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514759    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514763    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514766    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514769    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514771    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514774    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514777    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514779    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514782    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514784    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514787    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514789    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514792    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514794    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514796    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514799    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514802    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514804    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514806    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:07:47.516216 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514809    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514812    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514814    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514816    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514819    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514821    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514823    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514826    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514828    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514831    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514834    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514836    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514839    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514842    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514846    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514848    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514853    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514857    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514860    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:07:47.516709 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514863    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514866    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514869    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514872    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514874    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514877    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514879    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514882    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514884    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514887    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514890    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514892    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514894    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514897    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514901    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514904    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514907    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514909    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514912    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:07:47.517183 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514914    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514917    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514919    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514921    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514924    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514926    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514929    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514931    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514934    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514937    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514939    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514943    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514945    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514947    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514950    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514952    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514955    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514957    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514961    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514965    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:07:47.517737 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514968    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514970    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514973    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514976    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514978    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514980    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514983    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514985    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514987    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514990    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514992    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514994    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514997    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.514999    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515001    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515004    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515006    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515009    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515011    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:07:47.518241 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515359    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515365    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515367    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515370    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515373    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515376    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515379    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515382    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515384    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515387    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515389    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515392    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515394    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515397    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515399    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515402    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515405    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515407    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515410    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515413    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:07:47.518699 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515415    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515418    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515420    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515423    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515425    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515428    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515430    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515432    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515435    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515437    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515440    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515442    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515445    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515448    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515450    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515453    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515455    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515458    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515461    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515463    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:07:47.519191 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515466    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515468    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515471    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515473    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515475    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515478    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515480    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515483    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515485    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515488    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515490    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515493    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515496    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515498    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515500    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515503    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515505    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515507    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515511    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:07:47.519701 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515515    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515518    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515521    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515524    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515527    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515533    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515536    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515539    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515541    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515544    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515546    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515549    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515552    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515555    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515557    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515560    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515562    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515565    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515567    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515570    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:07:47.520150 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515572    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515575    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515577    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515580    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515582    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515584    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515587    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515590    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515593    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515596    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515598    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515601    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515603    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515606    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515608    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515610    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515613    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515617    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515621    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.515623    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:07:47.520684 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515701    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515709    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515715    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515719    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515723    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515726    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515730    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515734    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515737    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515740    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515743    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515746    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515749    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515752    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515755    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515757    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515760    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515763    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515767    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515770    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515773    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515776    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515779    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515782    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 00:07:47.521158 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515785    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515788    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515791    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515794    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515797    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515800    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515804    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515807    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515811    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515814    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515816    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515819    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515822    2559 flags.go:64] FLAG: --enable-server="true"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515825    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515829    2559 flags.go:64] FLAG: --event-burst="100"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515831    2559 flags.go:64] FLAG: --event-qps="50"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515834    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515837    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515839    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515843    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515845    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515848    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515850    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515853    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515856    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 00:07:47.521747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515859    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515861    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515864    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515867    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515869    2559 flags.go:64] FLAG: --feature-gates=""
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515873    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515875    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515878    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515881    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515884    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515886    2559 flags.go:64] FLAG: --help="false"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515889    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515892    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515897    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515899    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515903    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515906    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515909    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515912    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515914    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515917    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515920    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515923    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515926    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 29 00:07:47.522412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515929    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515932    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515935    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515937    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515940    2559 flags.go:64] FLAG: --lock-file=""
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515943    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515945    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515948    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515953    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515956    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515958    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515961    2559 flags.go:64] FLAG: --logging-format="text"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515963    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515967    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515969    2559 flags.go:64] FLAG: --manifest-url=""
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515972    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515976    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515979    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515983    2559 flags.go:64] FLAG: --max-pods="110"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515985    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515988    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515993    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515995    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.515998    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516001    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 00:07:47.523015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516004    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516010    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516013    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516015    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516018    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516022    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516027    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516029    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516032    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516035    2559 flags.go:64] FLAG: --port="10250"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516038    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516041    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d09964fcd6618875"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516043    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516046    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516049    2559 flags.go:64] FLAG: --register-node="true"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516051    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516055    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516057    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516060    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516062    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516065    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516068    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516071    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516073    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516076    2559 flags.go:64] FLAG: --runonce="false"
Jul 29 00:07:47.523647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516079    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516081    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516084    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516088    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516091    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516093    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516096    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516099    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516101    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516104    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516107    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516109    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516112    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516115    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516118    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516123    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516125    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516128    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516132    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516134    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516137    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516140    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516142    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516145    2559 flags.go:64] FLAG: --v="2"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516148    2559 flags.go:64] FLAG: --version="false"
Jul 29 00:07:47.524271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516152    2559 flags.go:64] FLAG: --vmodule=""
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516155    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516159    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516288    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516292    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516295    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516298    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516300    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516302    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516306    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516310    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516313    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516316    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516318    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516321    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516323    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516325    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516328    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516330    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516333    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:07:47.524863 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516335    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516339    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516342    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516344    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516346    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516349    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516351    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516354    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516356    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516359    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516361    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516364    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516366    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516368    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516371    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516373    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516375    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516378    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516380    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516383    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:07:47.525435 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516385    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516389    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516393    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516395    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516397    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516400    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516402    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516405    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516407    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516410    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516414    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516417    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516420    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516423    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516426    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516429    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516431    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516433    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516436    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516438    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:07:47.525937 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516441    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516443    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516446    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516448    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516450    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516453    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516455    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516457    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516460    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516464    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516467    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516470    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516472    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516476    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516480    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516483    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516485    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516488    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516490    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:07:47.526429 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516493    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516495    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516498    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516500    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516503    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516505    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516508    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516510    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516513    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516515    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516518    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516521    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516525    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516528    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516530    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516533    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516536    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516539    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516541    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516543    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:07:47.526892 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516546    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516548    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.516551    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.516556    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.523798    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.523811    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.524726    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.524734    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524790    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524795    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524799    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524802    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524805    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524808    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524810    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:07:47.527669 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524813    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524815    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524818    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524820    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524823    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524826    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524828    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524831    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524833    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524836    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524839    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524841    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524844    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524847    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524849    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524852    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524855    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524857    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524859    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524862    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:07:47.528202 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524864    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524867    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524870    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524874    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524876    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524879    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524881    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524884    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524886    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524889    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524891    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524894    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524896    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524898    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524901    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524903    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524905    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524908    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524911    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:07:47.528734 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524913    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524916    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524918    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524922    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524925    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524928    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524931    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524934    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524937    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524939    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524942    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524945    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524948    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524950    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524953    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524957    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524962    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524965    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524968    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524970    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:07:47.529210 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524973    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524975    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524978    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524980    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524983    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524985    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524988    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524990    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524993    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524995    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.524998    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525000    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525003    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525006    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525008    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525010    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525013    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525015    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525018    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525021    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:07:47.529714 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525023    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525026    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525029    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525031    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525034    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525037    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525039    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525044    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525047    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525050    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525052    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525055    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525057    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.525062    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 00:07:47.530227 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525186    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525193    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525197    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525200    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525202    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525205    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525208    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525211    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525214    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525217    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525219    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525223    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525225    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525228    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525230    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525233    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525236    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525240    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525243    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 00:07:47.530567 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525246    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525249    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525252    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525255    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525258    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525260    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525263    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525266    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525269    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525272    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525274    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525277    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525280    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525283    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525286    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525289    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525292    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525294    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525296    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 00:07:47.531014 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525299    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525302    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525304    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525306    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525309    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525311    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525314    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525316    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525319    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525321    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525324    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525326    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525328    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525331    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525333    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525335    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525338    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525341    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525343    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525346    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 00:07:47.531482 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525348    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525351    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525354    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525356    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525359    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525361    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525363    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525366    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525368    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525371    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525373    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525375    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525378    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525380    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525382    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525385    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525387    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525390    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525392    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525395    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525397    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 00:07:47.531968 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525400    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525402    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525405    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525407    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525409    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525412    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525414    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525417    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525420    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525422    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525425    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525428    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525430    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525433    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525435    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525438    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525440    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525443    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525446    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 00:07:47.532497 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:47.525448    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 00:07:47.532958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.525453    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 00:07:47.532958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.525545    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 00:07:47.532958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.528277    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 00:07:47.532958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.529990    2559 server.go:1019] "Starting client certificate rotation"
Jul 29 00:07:47.532958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.530083    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 00:07:47.532958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.530118    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 00:07:47.532958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.532806    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 00:07:47.534675 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.534661    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 00:07:47.543493 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.543479    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 29 00:07:47.546990 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.546976    2559 log.go:25] "Validated CRI v1 image API"
Jul 29 00:07:47.547850 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.547835    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 00:07:47.551900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.551881    2559 fs.go:135] Filesystem UUIDs: map[79dc33ca-315d-4ea0-87b0-a5b9f67545b6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 88f0d779-924c-46f5-9c71-cbec03151e5a:/dev/nvme0n1p4]
Jul 29 00:07:47.551956 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.551900    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 00:07:47.556343 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.556327    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 00:07:47.559124 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.559010    2559 manager.go:216] Machine: {Timestamp:2026-07-29 00:07:47.557639622 +0000 UTC m=+0.373590489 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099645 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bf6a48480d49a7c037e06bdb4dd73 SystemUUID:ec2bf6a4-8480-d49a-7c03-7e06bdb4dd73 BootID:db48676e-61d8-4e8d-be6a-a9497e9ff00c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:b9:74:05:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:b9:74:05:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:c0:dc:a1:8a:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 00:07:47.559124 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.559119    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 00:07:47.559243 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.559226    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 00:07:47.562692 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.562672    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 00:07:47.562826 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.562694    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 00:07:47.563518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.563508    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 00:07:47.563548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.563520    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 00:07:47.563548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.563527    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 00:07:47.563548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.563539    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 00:07:47.564747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.564737    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 00:07:47.566528 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.566518    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 00:07:47.566638 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.566629    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 00:07:47.566678 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.566661    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 00:07:47.566710 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.566685    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 00:07:47.566710 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.566705    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 00:07:47.566798 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.566713    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 29 00:07:47.566798 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.566739    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 00:07:47.567321 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.567304    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 00:07:47.567379 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.567331    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 00:07:47.571999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.571972    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 00:07:47.574461 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.574448    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 00:07:47.574503 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.574478    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 00:07:47.576527 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576516    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576531    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576537    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576542    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576550    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576555    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576563    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576568    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576577    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 00:07:47.576582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576585    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 00:07:47.576819 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576595    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 00:07:47.576819 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.576601    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 00:07:47.576879 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.576836    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 00:07:47.576935 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.576912    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 00:07:47.577471 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.577460    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 00:07:47.577502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.577474    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 00:07:47.580555 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.580544    2559 server.go:1268] "Started kubelet"
Jul 29 00:07:47.580640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.580606    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 00:07:47.580919 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.580635    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 00:07:47.580999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.580944    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 00:07:47.581342 ip-10-0-131-68 systemd[1]: Started Kubernetes Kubelet.
Jul 29 00:07:47.583015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.582999    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 00:07:47.583299 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.583285    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 00:07:47.585531 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.585506    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 00:07:47.589221 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.589205    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 00:07:47.590201 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.589113    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-68.ec2.internal.18c69a096d717f86  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-68.ec2.internal,UID:ip-10-0-131-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-68.ec2.internal,},FirstTimestamp:2026-07-29 00:07:47.580518278 +0000 UTC m=+0.396469175,LastTimestamp:2026-07-29 00:07:47.580518278 +0000 UTC m=+0.396469175,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-68.ec2.internal,}"
Jul 29 00:07:47.593092 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.593078    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 00:07:47.593193 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.593123    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 00:07:47.593274 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.593220    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:47.593911 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.593877    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 00:07:47.593911 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.593886    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 00:07:47.593911 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.593900    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 00:07:47.594049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594041    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 00:07:47.594086 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594052    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 00:07:47.594318 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594306    2559 factory.go:153] Registering CRI-O factory
Jul 29 00:07:47.594369 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594322    2559 factory.go:223] Registration of the crio container factory successfully
Jul 29 00:07:47.594412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594373    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 00:07:47.594412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594382    2559 factory.go:55] Registering systemd factory
Jul 29 00:07:47.594412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594390    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 29 00:07:47.594556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594429    2559 factory.go:103] Registering Raw factory
Jul 29 00:07:47.594556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594447    2559 manager.go:1196] Started watching for new ooms in manager
Jul 29 00:07:47.594909 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.594897    2559 manager.go:349] Starting recovery of all containers
Jul 29 00:07:47.595461 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.595432    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 00:07:47.595595 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.595567    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 00:07:47.603373 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.603347    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t4z6k"
Jul 29 00:07:47.607856 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.607834    2559 manager.go:354] Recovery completed
Jul 29 00:07:47.610390 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.610311    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t4z6k"
Jul 29 00:07:47.613229 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.613214    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:07:47.614768 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.614754    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:07:47.614834 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.614781    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:07:47.614834 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.614790    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:07:47.616496 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.615520    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 00:07:47.616496 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.615534    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 00:07:47.616496 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.615552    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 00:07:47.616496 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.615688    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:07:47.616496 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.616500    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:07:47.616705 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.616516    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:07:47.616705 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.616529    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:07:47.617350 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.617336    2559 policy_none.go:49] "None policy: Start"
Jul 29 00:07:47.617429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.617353    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 00:07:47.617429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.617366    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 00:07:47.618369 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.618357    2559 policy_none.go:47] "Start"
Jul 29 00:07:47.661929 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.661767    2559 manager.go:337] "Starting Device Plugin manager"
Jul 29 00:07:47.662026 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.661937    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 00:07:47.662026 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.661950    2559 server.go:87] "Starting device plugin registration server"
Jul 29 00:07:47.662265 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.662251    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 00:07:47.662327 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.662273    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 00:07:47.662391 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.662370    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 00:07:47.662459 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.662446    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 00:07:47.662510 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.662460    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 00:07:47.662996 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.662980    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 00:07:47.663070 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.663021    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:47.673852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.673825    2559 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2593 into the system container \"/system.slice\": <nil>"
Jul 29 00:07:47.751501 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.751463    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 00:07:47.752830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.752814    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 00:07:47.752918 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.752851    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 00:07:47.752918 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.752873    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 00:07:47.752918 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.752906    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 00:07:47.755002 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.754977    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:07:47.762873 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.762817    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:07:47.763623 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.763607    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:07:47.763689 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.763638    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:07:47.763689 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.763655    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:07:47.763689 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.763681    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.771800 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.771786    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.771872 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.771806    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-68.ec2.internal\": node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:47.793643 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.793624    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:47.853696 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.853652    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"]
Jul 29 00:07:47.853835 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.853732    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:07:47.855318 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.855301    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:07:47.855398 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.855328    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:07:47.855398 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.855338    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:07:47.856457 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.856445    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:07:47.856574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.856558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.856653 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.856589    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:07:47.857119 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.857105    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:07:47.857205 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.857109    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:07:47.857205 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.857137    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:07:47.857205 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.857150    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:07:47.857205 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.857151    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:07:47.857327 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.857214    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:07:47.858310 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.858296    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.858376 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.858319    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 00:07:47.858905 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.858891    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 00:07:47.858970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.858914    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 00:07:47.858970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.858923    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeHasSufficientPID"
Jul 29 00:07:47.875684 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.875662    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-68.ec2.internal\" not found" node="ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.879947 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.879931    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-68.ec2.internal\" not found" node="ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.893740 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.893724    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:47.895959 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.895941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c5be3bf8d90d1a26a031c410bee150f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-68.ec2.internal\" (UID: \"6c5be3bf8d90d1a26a031c410bee150f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.896015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.895968    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a539e12309be141463a83f50bea37af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal\" (UID: \"8a539e12309be141463a83f50bea37af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.896015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.895986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a539e12309be141463a83f50bea37af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal\" (UID: \"8a539e12309be141463a83f50bea37af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.994489 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:47.994453    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:47.996641 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.996622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c5be3bf8d90d1a26a031c410bee150f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-68.ec2.internal\" (UID: \"6c5be3bf8d90d1a26a031c410bee150f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.996725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.996654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a539e12309be141463a83f50bea37af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal\" (UID: \"8a539e12309be141463a83f50bea37af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.996725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.996680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a539e12309be141463a83f50bea37af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal\" (UID: \"8a539e12309be141463a83f50bea37af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.996725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.996716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c5be3bf8d90d1a26a031c410bee150f-config\") pod \"kube-apiserver-proxy-ip-10-0-131-68.ec2.internal\" (UID: \"6c5be3bf8d90d1a26a031c410bee150f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.996849 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.996726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a539e12309be141463a83f50bea37af-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal\" (UID: \"8a539e12309be141463a83f50bea37af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:47.996849 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:47.996716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a539e12309be141463a83f50bea37af-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal\" (UID: \"8a539e12309be141463a83f50bea37af\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:48.095240 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:48.095189    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:48.178578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.178546    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:48.183292 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.183275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:48.196275 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:48.196260    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:48.296843 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:48.296818    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:48.397328 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:48.397274    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:48.497854 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:48.497832    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:48.529118 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.529099    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 00:07:48.529517 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.529244    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 00:07:48.572843 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.572821    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:07:48.598649 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:48.598632    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:48.616625 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.616592    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 00:02:48 +0000 UTC" deadline="2028-04-11 04:55:27.10638093 +0000 UTC"
Jul 29 00:07:48.616698 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.616625    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14932h47m38.489759991s"
Jul 29 00:07:48.626520 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.626503    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:07:48.699284 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:48.699212    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:48.719764 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:48.719730    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5be3bf8d90d1a26a031c410bee150f.slice/crio-fb16f03693c92b9f5eb94b4012ae8fd20a6466c2bf81ba5ce9a46c01ffeb360b WatchSource:0}: Error finding container fb16f03693c92b9f5eb94b4012ae8fd20a6466c2bf81ba5ce9a46c01ffeb360b: Status 404 returned error can't find the container with id fb16f03693c92b9f5eb94b4012ae8fd20a6466c2bf81ba5ce9a46c01ffeb360b
Jul 29 00:07:48.720269 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:48.720253    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a539e12309be141463a83f50bea37af.slice/crio-e6c51a8c0c91dec8b908904b3d5ae721802a6ff2dfcd4c597e284783d9a78f4e WatchSource:0}: Error finding container e6c51a8c0c91dec8b908904b3d5ae721802a6ff2dfcd4c597e284783d9a78f4e: Status 404 returned error can't find the container with id e6c51a8c0c91dec8b908904b3d5ae721802a6ff2dfcd4c597e284783d9a78f4e
Jul 29 00:07:48.724311 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.724292    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 00:07:48.756188 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.756139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal" event={"ID":"6c5be3bf8d90d1a26a031c410bee150f","Type":"ContainerStarted","Data":"fb16f03693c92b9f5eb94b4012ae8fd20a6466c2bf81ba5ce9a46c01ffeb360b"}
Jul 29 00:07:48.757464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.757445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal" event={"ID":"8a539e12309be141463a83f50bea37af","Type":"ContainerStarted","Data":"e6c51a8c0c91dec8b908904b3d5ae721802a6ff2dfcd4c597e284783d9a78f4e"}
Jul 29 00:07:48.799883 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:48.799862    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-68.ec2.internal\" not found"
Jul 29 00:07:48.890639 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.890618    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:07:48.893736 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.893719    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:48.904991 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.903570    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 00:07:48.904991 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.904496    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal"
Jul 29 00:07:48.914810 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:48.914791    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 00:07:50.819092 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.819016    2559 apiserver.go:52] "Watching apiserver"
Jul 29 00:07:50.827985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.827950    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 00:07:50.828373 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.828340    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-sxmbj","openshift-network-diagnostics/network-check-target-j8rqp","openshift-network-operator/iptables-alerter-hbcz5","openshift-ovn-kubernetes/ovnkube-node-4htfh","kube-system/global-pull-secret-syncer-bhjtq","kube-system/konnectivity-agent-6fbtp","kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal","openshift-dns/node-resolver-4r45s","openshift-image-registry/node-ca-ln7s8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal","openshift-multus/multus-additional-cni-plugins-zf2fm","openshift-multus/multus-ww9p9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt","openshift-cluster-node-tuning-operator/tuned-sp27m"]
Jul 29 00:07:50.829794 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.829775    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.830995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.830972    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:50.831137 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.831057    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:07:50.832557 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.832227    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.832557 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.832380    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 00:07:50.832740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.832624    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zt4gk\""
Jul 29 00:07:50.832798 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.832759    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 00:07:50.832852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.832838    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 00:07:50.833576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.833559    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.834967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.834640    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:07:50.834967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.834761    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nvch9\""
Jul 29 00:07:50.834967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.834790    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 00:07:50.834967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.834895    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.834967 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.834958    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:07:50.835271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.835105    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 00:07:50.835939 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.835921    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:07:50.836281 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.836242    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 00:07:50.836532 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.836512    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 00:07:50.836532 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.836528    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 00:07:50.836659 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.836572    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9b7zq\""
Jul 29 00:07:50.836659 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.836524    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 00:07:50.837353 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.837333    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 00:07:50.837514 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.837497    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 00:07:50.837833 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.837815    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:50.837927 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.837876    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:07:50.838165 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.838122    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 00:07:50.839136 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.838887    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 00:07:50.839136 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.839022    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.839136 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.839097    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6dchb\""
Jul 29 00:07:50.840245 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.840224    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.841425 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.841406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.841948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.841927    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 00:07:50.842034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.841975    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 00:07:50.842034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.842029    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lrwgv\""
Jul 29 00:07:50.842790 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.842772    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.842873 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.842803    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 00:07:50.843359 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.843340    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 00:07:50.843734 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.843716    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5mvkx\""
Jul 29 00:07:50.843838 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.843823    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 00:07:50.843894 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.843879    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:07:50.843964 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.843948    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rrjsf\""
Jul 29 00:07:50.844094 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.844077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.844354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.844335    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 00:07:50.845154 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.845137    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 00:07:50.847178 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.847081    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 00:07:50.847278 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.847199    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 00:07:50.847516 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.847497    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 00:07:50.847645 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.847626    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gnk4m\""
Jul 29 00:07:50.848009 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.847991    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 00:07:50.849048 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.848810    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 00:07:50.849146 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.849132    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 00:07:50.849222 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.849199    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tg49g\""
Jul 29 00:07:50.851883 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.851826    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 00:07:50.857225 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.857202    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 00:07:50.857907 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.857883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-systemd\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.857994 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.857921    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-tuned\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.857994 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.857964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.857994 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.857989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-etc-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.858146 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9d4\" (UniqueName: \"kubernetes.io/projected/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-kube-api-access-fv9d4\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.858146 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-var-lib-kubelet\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.858146 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4swm\" (UniqueName: \"kubernetes.io/projected/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-kube-api-access-q4swm\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.858146 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:50.858146 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f17b3342-f2d9-4d7c-be38-74d1580f30a1-iptables-alerter-script\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.858146 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d023894-c69b-42ef-8eb8-ec818b0957d2-konnectivity-ca\") pod \"konnectivity-agent-6fbtp\" (UID: \"0d023894-c69b-42ef-8eb8-ec818b0957d2\") " pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858168    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-kubernetes\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84061f31-807c-4245-adb1-8ac55c66d1ac-cni-binary-copy\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-etc-kubernetes\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-systemd-units\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zfw9\" (UniqueName: \"kubernetes.io/projected/65fb6704-d388-47d9-b29b-c69c04bb0f11-kube-api-access-5zfw9\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-sys\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-cni-multus\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-cni-bin\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovnkube-config\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.858412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-sys-fs\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858426    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-node-log\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-registration-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858510    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysconfig\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858553    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-cnibin\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858574    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-socket-dir-parent\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-k8s-cni-cncf-io\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-daemon-config\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d023894-c69b-42ef-8eb8-ec818b0957d2-agent-certs\") pod \"konnectivity-agent-6fbtp\" (UID: \"0d023894-c69b-42ef-8eb8-ec818b0957d2\") " pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-tmp\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-env-overrides\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858761    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk7fq\" (UniqueName: \"kubernetes.io/projected/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-kube-api-access-fk7fq\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:50.859999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-system-cni-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858817    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-socket-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858840    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-systemd\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858862    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-ovn\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx5k2\" (UniqueName: \"kubernetes.io/projected/dd528d51-9db8-40fd-a06c-7b382f9c6393-kube-api-access-hx5k2\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-cni-bin\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.858966    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-run-netns\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859026    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9fa5013-f680-42b7-87a2-4c368f648a14-kubelet-config\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cnibin\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-device-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps2wr\" (UniqueName: \"kubernetes.io/projected/d00dead9-ed29-4e34-bff5-2210ea44ccd9-kube-api-access-ps2wr\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859166    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovnkube-script-lib\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9fa5013-f680-42b7-87a2-4c368f648a14-dbus\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-os-release\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65fb6704-d388-47d9-b29b-c69c04bb0f11-host\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.860788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-run\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4w6b\" (UniqueName: \"kubernetes.io/projected/f17b3342-f2d9-4d7c-be38-74d1580f30a1-kube-api-access-p4w6b\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-conf-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859356    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-cni-netd\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-kubelet\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-slash\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-var-lib-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859495    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-modprobe-d\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859518    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysctl-d\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysctl-conf\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-log-socket\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65fb6704-d388-47d9-b29b-c69c04bb0f11-serviceca\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd528d51-9db8-40fd-a06c-7b382f9c6393-hosts-file\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd528d51-9db8-40fd-a06c-7b382f9c6393-tmp-dir\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.861502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-cni-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-netns\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-multus-certs\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859834    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-lib-modules\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-host\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-hostroot\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsnr4\" (UniqueName: \"kubernetes.io/projected/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-kube-api-access-gsnr4\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.859970    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-system-cni-dir\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.860006    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-os-release\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.860034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.860062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f17b3342-f2d9-4d7c-be38-74d1580f30a1-host-slash\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.860087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-kubelet\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.860113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp48d\" (UniqueName: \"kubernetes.io/projected/84061f31-807c-4245-adb1-8ac55c66d1ac-kube-api-access-mp48d\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.862161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.860139    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovn-node-metrics-cert\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.880704 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.880678    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qjfhc"
Jul 29 00:07:50.887962 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.887941    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qjfhc"
Jul 29 00:07:50.960831 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.960797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.961005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.960840    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65fb6704-d388-47d9-b29b-c69c04bb0f11-serviceca\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.961005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.960869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd528d51-9db8-40fd-a06c-7b382f9c6393-hosts-file\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.961005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.960892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd528d51-9db8-40fd-a06c-7b382f9c6393-tmp-dir\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.961005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.960919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-cni-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.961005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.960965    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-netns\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.961005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.960991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-multus-certs\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-lib-modules\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961078    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-host\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961098    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-hostroot\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsnr4\" (UniqueName: \"kubernetes.io/projected/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-kube-api-access-gsnr4\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-system-cni-dir\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-os-release\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961166    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961171    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-lib-modules\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961185    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f17b3342-f2d9-4d7c-be38-74d1580f30a1-host-slash\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-kubelet\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961229    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp48d\" (UniqueName: \"kubernetes.io/projected/84061f31-807c-4245-adb1-8ac55c66d1ac-kube-api-access-mp48d\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961255    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovn-node-metrics-cert\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-systemd\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961291    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-tuned\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.961303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-etc-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9d4\" (UniqueName: \"kubernetes.io/projected/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-kube-api-access-fv9d4\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-var-lib-kubelet\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4swm\" (UniqueName: \"kubernetes.io/projected/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-kube-api-access-q4swm\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f17b3342-f2d9-4d7c-be38-74d1580f30a1-iptables-alerter-script\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d023894-c69b-42ef-8eb8-ec818b0957d2-konnectivity-ca\") pod \"konnectivity-agent-6fbtp\" (UID: \"0d023894-c69b-42ef-8eb8-ec818b0957d2\") " pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-kubernetes\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961453    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84061f31-807c-4245-adb1-8ac55c66d1ac-cni-binary-copy\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-etc-kubernetes\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961472    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd528d51-9db8-40fd-a06c-7b382f9c6393-tmp-dir\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961481    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-systemd-units\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zfw9\" (UniqueName: \"kubernetes.io/projected/65fb6704-d388-47d9-b29b-c69c04bb0f11-kube-api-access-5zfw9\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961705    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-cni-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-sys\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.962122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-cni-multus\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-cni-bin\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961858    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovnkube-config\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-sys-fs\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961905    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-node-log\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961957    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-registration-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.961981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysconfig\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962030    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962045    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-cnibin\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65fb6704-d388-47d9-b29b-c69c04bb0f11-serviceca\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-socket-dir-parent\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-k8s-cni-cncf-io\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-daemon-config\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.962974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d023894-c69b-42ef-8eb8-ec818b0957d2-agent-certs\") pod \"konnectivity-agent-6fbtp\" (UID: \"0d023894-c69b-42ef-8eb8-ec818b0957d2\") " pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-tmp\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-etc-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-env-overrides\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962276    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk7fq\" (UniqueName: \"kubernetes.io/projected/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-kube-api-access-fk7fq\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-system-cni-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-socket-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-systemd\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-ovn\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx5k2\" (UniqueName: \"kubernetes.io/projected/dd528d51-9db8-40fd-a06c-7b382f9c6393-kube-api-access-hx5k2\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962421    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-cni-bin\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-run-netns\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962459    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-var-lib-kubelet\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962469    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9fa5013-f680-42b7-87a2-4c368f648a14-kubelet-config\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cnibin\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-device-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.963750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps2wr\" (UniqueName: \"kubernetes.io/projected/d00dead9-ed29-4e34-bff5-2210ea44ccd9-kube-api-access-ps2wr\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovnkube-script-lib\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962626    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9fa5013-f680-42b7-87a2-4c368f648a14-dbus\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-os-release\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65fb6704-d388-47d9-b29b-c69c04bb0f11-host\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-run\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4w6b\" (UniqueName: \"kubernetes.io/projected/f17b3342-f2d9-4d7c-be38-74d1580f30a1-kube-api-access-p4w6b\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-conf-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-cni-netd\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-kubelet\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-slash\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-var-lib-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-modprobe-d\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962937    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysctl-d\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysctl-conf\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.962988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-log-socket\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.964429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963085    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-log-socket\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963103    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f17b3342-f2d9-4d7c-be38-74d1580f30a1-iptables-alerter-script\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963127    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-netns\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963181    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dd528d51-9db8-40fd-a06c-7b382f9c6393-hosts-file\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963231    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-multus-certs\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963295    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-host\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963312    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-sys\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-hostroot\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963494    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-system-cni-dir\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-os-release\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963771    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0d023894-c69b-42ef-8eb8-ec818b0957d2-konnectivity-ca\") pod \"konnectivity-agent-6fbtp\" (UID: \"0d023894-c69b-42ef-8eb8-ec818b0957d2\") " pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963834    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-kubernetes\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-cni-multus\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f17b3342-f2d9-4d7c-be38-74d1580f30a1-host-slash\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-kubelet\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.965121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.963981    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-cni-bin\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964393    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84061f31-807c-4245-adb1-8ac55c66d1ac-cni-binary-copy\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovnkube-config\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964453    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-etc-kubernetes\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964495    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-systemd-units\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964514    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-sys-fs\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-run-netns\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-run-ovn-kubernetes\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964572    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-node-log\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964646    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-systemd\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.964650    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964703    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-registration-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.964741    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs podName:6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:51.464722541 +0000 UTC m=+3.029175495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs") pod "network-metrics-daemon-sxmbj" (UID: "6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964779    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-etc-selinux\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9fa5013-f680-42b7-87a2-4c368f648a14-kubelet-config\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964820    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysconfig\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cnibin\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.965945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-socket-dir-parent\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-run-k8s-cni-cncf-io\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-cnibin\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964915    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-conf-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.964962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-kubelet\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.964985    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965000    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-cni-netd\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965050    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.965071    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret podName:e9fa5013-f680-42b7-87a2-4c368f648a14 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:51.465054639 +0000 UTC m=+3.029507572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret") pod "global-pull-secret-syncer-bhjtq" (UID: "e9fa5013-f680-42b7-87a2-4c368f648a14") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965093    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-host-slash\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-modprobe-d\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965247    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysctl-d\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-sysctl-conf\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovnkube-script-lib\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965618    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-var-lib-openvswitch\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9fa5013-f680-42b7-87a2-4c368f648a14-dbus\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965748    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-os-release\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965785    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65fb6704-d388-47d9-b29b-c69c04bb0f11-host\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.966741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.965836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-run\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966041    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-device-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966350    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84061f31-807c-4245-adb1-8ac55c66d1ac-multus-daemon-config\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-cni-binary-copy\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d00dead9-ed29-4e34-bff5-2210ea44ccd9-socket-dir\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966824    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-system-cni-dir\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966857    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-env-overrides\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84061f31-807c-4245-adb1-8ac55c66d1ac-host-var-lib-cni-bin\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-systemd\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.967581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.966989    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-run-ovn\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.968525 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.968506    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:07:50.968613 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.968530    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:07:50.968613 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.968543    2559 projected.go:196] Error preparing data for projected volume kube-api-access-zbh67 for pod openshift-network-diagnostics/network-check-target-j8rqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:50.968613 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:50.968600    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67 podName:13a74c44-28db-4ee5-aa0c-1919313defa3 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:51.468585842 +0000 UTC m=+3.033038784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zbh67" (UniqueName: "kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67") pod "network-check-target-j8rqp" (UID: "13a74c44-28db-4ee5-aa0c-1919313defa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:50.968852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.968830    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-etc-tuned\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.970719 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.970393    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-tmp\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.980132 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.980032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-ovn-node-metrics-cert\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.983090 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.983068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp48d\" (UniqueName: \"kubernetes.io/projected/84061f31-807c-4245-adb1-8ac55c66d1ac-kube-api-access-mp48d\") pod \"multus-ww9p9\" (UID: \"84061f31-807c-4245-adb1-8ac55c66d1ac\") " pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:50.983564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.983545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4w6b\" (UniqueName: \"kubernetes.io/projected/f17b3342-f2d9-4d7c-be38-74d1580f30a1-kube-api-access-p4w6b\") pod \"iptables-alerter-hbcz5\" (UID: \"f17b3342-f2d9-4d7c-be38-74d1580f30a1\") " pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:50.983737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.983715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9d4\" (UniqueName: \"kubernetes.io/projected/95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c-kube-api-access-fv9d4\") pod \"ovnkube-node-4htfh\" (UID: \"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c\") " pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:50.984172 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.984148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4swm\" (UniqueName: \"kubernetes.io/projected/2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb-kube-api-access-q4swm\") pod \"multus-additional-cni-plugins-zf2fm\" (UID: \"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb\") " pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:50.986414 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.985025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zfw9\" (UniqueName: \"kubernetes.io/projected/65fb6704-d388-47d9-b29b-c69c04bb0f11-kube-api-access-5zfw9\") pod \"node-ca-ln7s8\" (UID: \"65fb6704-d388-47d9-b29b-c69c04bb0f11\") " pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:50.990301 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.990277    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsnr4\" (UniqueName: \"kubernetes.io/projected/917bb460-051d-4d25-b8d9-bdd84ee6a2d4-kube-api-access-gsnr4\") pod \"tuned-sp27m\" (UID: \"917bb460-051d-4d25-b8d9-bdd84ee6a2d4\") " pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:50.991040 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.991016    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0d023894-c69b-42ef-8eb8-ec818b0957d2-agent-certs\") pod \"konnectivity-agent-6fbtp\" (UID: \"0d023894-c69b-42ef-8eb8-ec818b0957d2\") " pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:07:50.991134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.991060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps2wr\" (UniqueName: \"kubernetes.io/projected/d00dead9-ed29-4e34-bff5-2210ea44ccd9-kube-api-access-ps2wr\") pod \"aws-ebs-csi-driver-node-k75nt\" (UID: \"d00dead9-ed29-4e34-bff5-2210ea44ccd9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:50.992934 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.992890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx5k2\" (UniqueName: \"kubernetes.io/projected/dd528d51-9db8-40fd-a06c-7b382f9c6393-kube-api-access-hx5k2\") pod \"node-resolver-4r45s\" (UID: \"dd528d51-9db8-40fd-a06c-7b382f9c6393\") " pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:50.993852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:50.993826    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk7fq\" (UniqueName: \"kubernetes.io/projected/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-kube-api-access-fk7fq\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:51.144236 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.144153    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 00:07:51.144463 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.144446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt"
Jul 29 00:07:51.162861 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.162838    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hbcz5"
Jul 29 00:07:51.174271 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.174242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:07:51.178999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.178979    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:07:51.187807 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.187790    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ln7s8"
Jul 29 00:07:51.195447 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.195428    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4r45s"
Jul 29 00:07:51.201951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.201934    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sp27m"
Jul 29 00:07:51.210465 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.210446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zf2fm"
Jul 29 00:07:51.217886 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.217868    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ww9p9"
Jul 29 00:07:51.466421 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.466338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:51.466421 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.466380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:51.466606 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:51.466493    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:51.466606 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:51.466504    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:51.466606 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:51.466549    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret podName:e9fa5013-f680-42b7-87a2-4c368f648a14 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:52.466534887 +0000 UTC m=+4.030987817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret") pod "global-pull-secret-syncer-bhjtq" (UID: "e9fa5013-f680-42b7-87a2-4c368f648a14") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:51.466606 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:51.466576    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs podName:6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:52.466556266 +0000 UTC m=+4.031009210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs") pod "network-metrics-daemon-sxmbj" (UID: "6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:51.567301 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.567264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:51.567482 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:51.567427    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:07:51.567482 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:51.567453    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:07:51.567482 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:51.567463    2559 projected.go:196] Error preparing data for projected volume kube-api-access-zbh67 for pod openshift-network-diagnostics/network-check-target-j8rqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:51.567608 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:51.567513    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67 podName:13a74c44-28db-4ee5-aa0c-1919313defa3 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:52.567498694 +0000 UTC m=+4.131951623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbh67" (UniqueName: "kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67") pod "network-check-target-j8rqp" (UID: "13a74c44-28db-4ee5-aa0c-1919313defa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:51.891339 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.891305    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 00:02:50 +0000 UTC" deadline="2028-03-25 00:13:17.908781733 +0000 UTC"
Jul 29 00:07:51.891339 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:51.891334    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14520h5m26.017451079s"
Jul 29 00:07:52.005279 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:52.005255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:52.005482 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.005462    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:07:52.008075 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:52.008052    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00dead9_ed29_4e34_bff5_2210ea44ccd9.slice/crio-d6b46946205353306e0292dea4405fea30f182c672f3e963b2107dfe0fbbf707 WatchSource:0}: Error finding container d6b46946205353306e0292dea4405fea30f182c672f3e963b2107dfe0fbbf707: Status 404 returned error can't find the container with id d6b46946205353306e0292dea4405fea30f182c672f3e963b2107dfe0fbbf707
Jul 29 00:07:52.013230 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:52.013164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt" event={"ID":"d00dead9-ed29-4e34-bff5-2210ea44ccd9","Type":"ContainerStarted","Data":"d6b46946205353306e0292dea4405fea30f182c672f3e963b2107dfe0fbbf707"}
Jul 29 00:07:52.032042 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:52.032023    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b46184a_f9d7_4b39_ae2f_0b77c9bc3ceb.slice/crio-ffde8cd72232fc8bd8934aa81d5ea5ed62f8e8e06a852b32a0459df49b493c73 WatchSource:0}: Error finding container ffde8cd72232fc8bd8934aa81d5ea5ed62f8e8e06a852b32a0459df49b493c73: Status 404 returned error can't find the container with id ffde8cd72232fc8bd8934aa81d5ea5ed62f8e8e06a852b32a0459df49b493c73
Jul 29 00:07:52.033220 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:52.033165    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17b3342_f2d9_4d7c_be38_74d1580f30a1.slice/crio-069f4452d614600454004307cdb12b477bc016b4d7e041bb1cf8c978d1faf0c1 WatchSource:0}: Error finding container 069f4452d614600454004307cdb12b477bc016b4d7e041bb1cf8c978d1faf0c1: Status 404 returned error can't find the container with id 069f4452d614600454004307cdb12b477bc016b4d7e041bb1cf8c978d1faf0c1
Jul 29 00:07:52.034412 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:52.034329    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917bb460_051d_4d25_b8d9_bdd84ee6a2d4.slice/crio-6f56610f0fb4312ee34847a8b9285c029491099efee7162e0c24c28e7b598b62 WatchSource:0}: Error finding container 6f56610f0fb4312ee34847a8b9285c029491099efee7162e0c24c28e7b598b62: Status 404 returned error can't find the container with id 6f56610f0fb4312ee34847a8b9285c029491099efee7162e0c24c28e7b598b62
Jul 29 00:07:52.035517 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:52.035030    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d023894_c69b_42ef_8eb8_ec818b0957d2.slice/crio-6a5deb675a3af41fa7b69b920c602391c380540c5598eccdf86147591b92d778 WatchSource:0}: Error finding container 6a5deb675a3af41fa7b69b920c602391c380540c5598eccdf86147591b92d778: Status 404 returned error can't find the container with id 6a5deb675a3af41fa7b69b920c602391c380540c5598eccdf86147591b92d778
Jul 29 00:07:52.036592 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:07:52.036181    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd528d51_9db8_40fd_a06c_7b382f9c6393.slice/crio-8881b328298906f2016178dbf9d9ebbb019f0a862aca59dfaa4f17f4924b19b6 WatchSource:0}: Error finding container 8881b328298906f2016178dbf9d9ebbb019f0a862aca59dfaa4f17f4924b19b6: Status 404 returned error can't find the container with id 8881b328298906f2016178dbf9d9ebbb019f0a862aca59dfaa4f17f4924b19b6
Jul 29 00:07:52.472625 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:52.472590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:52.472820 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:52.472629    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:52.472820 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.472767    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:52.472820 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.472767    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:52.472949 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.472835    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret podName:e9fa5013-f680-42b7-87a2-4c368f648a14 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:54.472819911 +0000 UTC m=+6.037272860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret") pod "global-pull-secret-syncer-bhjtq" (UID: "e9fa5013-f680-42b7-87a2-4c368f648a14") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:52.472949 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.472850    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs podName:6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:54.472844354 +0000 UTC m=+6.037297283 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs") pod "network-metrics-daemon-sxmbj" (UID: "6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:52.573187 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:52.573150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:52.573390 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.573372    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:07:52.573445 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.573401    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:07:52.573445 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.573414    2559 projected.go:196] Error preparing data for projected volume kube-api-access-zbh67 for pod openshift-network-diagnostics/network-check-target-j8rqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:52.573542 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:52.573471    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67 podName:13a74c44-28db-4ee5-aa0c-1919313defa3 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:54.573452772 +0000 UTC m=+6.137905703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbh67" (UniqueName: "kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67") pod "network-check-target-j8rqp" (UID: "13a74c44-28db-4ee5-aa0c-1919313defa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:52.892022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:52.891928    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 00:02:50 +0000 UTC" deadline="2028-05-01 18:28:00.665833482 +0000 UTC"
Jul 29 00:07:52.892022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:52.891975    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15426h20m7.773864871s"
Jul 29 00:07:53.015779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.014974    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:53.015779 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:53.015097    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:07:53.015779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.015628    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:53.015779 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:53.015739    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:07:53.030417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.030389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4r45s" event={"ID":"dd528d51-9db8-40fd-a06c-7b382f9c6393","Type":"ContainerStarted","Data":"8881b328298906f2016178dbf9d9ebbb019f0a862aca59dfaa4f17f4924b19b6"}
Jul 29 00:07:53.033209 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.033186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hbcz5" event={"ID":"f17b3342-f2d9-4d7c-be38-74d1580f30a1","Type":"ContainerStarted","Data":"069f4452d614600454004307cdb12b477bc016b4d7e041bb1cf8c978d1faf0c1"}
Jul 29 00:07:53.036631 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.036592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" event={"ID":"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb","Type":"ContainerStarted","Data":"ffde8cd72232fc8bd8934aa81d5ea5ed62f8e8e06a852b32a0459df49b493c73"}
Jul 29 00:07:53.041096 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.041066    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal" event={"ID":"6c5be3bf8d90d1a26a031c410bee150f","Type":"ContainerStarted","Data":"6c1860551882244f00720417c9db0f6d5ec46792dd9b85fe447899bcd94c56f3"}
Jul 29 00:07:53.048556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.048533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ln7s8" event={"ID":"65fb6704-d388-47d9-b29b-c69c04bb0f11","Type":"ContainerStarted","Data":"3d315b96256772d591af445f7b1c527d954b0594c160d4a74239e481b08a726f"}
Jul 29 00:07:53.057761 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.057712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"14c2363c3df0689afb33025ee0c7280a752ef3315d9eea4706c3578f5e643f72"}
Jul 29 00:07:53.063585 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.063558    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6fbtp" event={"ID":"0d023894-c69b-42ef-8eb8-ec818b0957d2","Type":"ContainerStarted","Data":"6a5deb675a3af41fa7b69b920c602391c380540c5598eccdf86147591b92d778"}
Jul 29 00:07:53.072919 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.072893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ww9p9" event={"ID":"84061f31-807c-4245-adb1-8ac55c66d1ac","Type":"ContainerStarted","Data":"48f93fcf37f44a4599e7c35645f24f668baa6fa4efc4fed6d114397479347476"}
Jul 29 00:07:53.078422 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.078395    2559 generic.go:356] "Generic (PLEG): container finished" podID="8a539e12309be141463a83f50bea37af" containerID="f7988dfa1753a1831f29d6873c121522d3409b091aabd11f0aef63ac1a22ead4" exitCode=0
Jul 29 00:07:53.078517 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.078474    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal" event={"ID":"8a539e12309be141463a83f50bea37af","Type":"ContainerDied","Data":"f7988dfa1753a1831f29d6873c121522d3409b091aabd11f0aef63ac1a22ead4"}
Jul 29 00:07:53.083035 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.083011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sp27m" event={"ID":"917bb460-051d-4d25-b8d9-bdd84ee6a2d4","Type":"ContainerStarted","Data":"6f56610f0fb4312ee34847a8b9285c029491099efee7162e0c24c28e7b598b62"}
Jul 29 00:07:53.096149 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:53.096090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-68.ec2.internal" podStartSLOduration=3.096070355 podStartE2EDuration="3.096070355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:07:53.05769745 +0000 UTC m=+4.622150404" watchObservedRunningTime="2026-07-29 00:07:53.096070355 +0000 UTC m=+4.660523308"
Jul 29 00:07:54.005314 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:54.005260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:54.005888 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.005393    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:07:54.101095 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:54.099508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal" event={"ID":"8a539e12309be141463a83f50bea37af","Type":"ContainerStarted","Data":"595d1303720cf365b588bbfc4bdc1f8eaf48c85589618b24cfccb56f4e397be8"}
Jul 29 00:07:54.490109 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:54.490005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:54.490109 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:54.490058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:54.490295 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.490175    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:54.490295 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.490175    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:54.490295 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.490237    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs podName:6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:58.490219461 +0000 UTC m=+10.054672391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs") pod "network-metrics-daemon-sxmbj" (UID: "6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:54.490295 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.490255    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret podName:e9fa5013-f680-42b7-87a2-4c368f648a14 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:58.490246422 +0000 UTC m=+10.054699351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret") pod "global-pull-secret-syncer-bhjtq" (UID: "e9fa5013-f680-42b7-87a2-4c368f648a14") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:54.590750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:54.590718    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:54.590924 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.590898    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:07:54.590924 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.590917    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:07:54.591022 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.590929    2559 projected.go:196] Error preparing data for projected volume kube-api-access-zbh67 for pod openshift-network-diagnostics/network-check-target-j8rqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:54.591022 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:54.590987    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67 podName:13a74c44-28db-4ee5-aa0c-1919313defa3 nodeName:}" failed. No retries permitted until 2026-07-29 00:07:58.590966019 +0000 UTC m=+10.155418961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbh67" (UniqueName: "kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67") pod "network-check-target-j8rqp" (UID: "13a74c44-28db-4ee5-aa0c-1919313defa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:55.007462 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:55.007433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:55.007895 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:55.007560    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:07:55.008054 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:55.007965    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:55.008134 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:55.008065    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:07:56.005627 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:56.005148    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:56.005627 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:56.005298    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:07:57.005362 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:57.005327    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:57.005791 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:57.005461    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:07:57.005923 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:57.005895    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:57.006043 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:57.006009    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:07:58.005041 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:58.005006    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:58.005214 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.005130    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:07:58.525696 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:58.524946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:07:58.525696 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:58.524994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:58.525696 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.525133    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:58.525696 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.525192    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret podName:e9fa5013-f680-42b7-87a2-4c368f648a14 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:06.525174139 +0000 UTC m=+18.089627073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret") pod "global-pull-secret-syncer-bhjtq" (UID: "e9fa5013-f680-42b7-87a2-4c368f648a14") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:07:58.525696 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.525598    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:58.525696 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.525647    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs podName:6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:06.525630696 +0000 UTC m=+18.090083629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs") pod "network-metrics-daemon-sxmbj" (UID: "6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:07:58.626036 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:58.625994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:58.626210 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.626178    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:07:58.626210 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.626200    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:07:58.626310 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.626212    2559 projected.go:196] Error preparing data for projected volume kube-api-access-zbh67 for pod openshift-network-diagnostics/network-check-target-j8rqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:58.626310 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:58.626266    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67 podName:13a74c44-28db-4ee5-aa0c-1919313defa3 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:06.626249604 +0000 UTC m=+18.190702536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbh67" (UniqueName: "kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67") pod "network-check-target-j8rqp" (UID: "13a74c44-28db-4ee5-aa0c-1919313defa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:07:59.006396 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:59.006331    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:07:59.006525 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:59.006407    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:07:59.006715 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:07:59.006699    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:07:59.006808 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:07:59.006790    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:00.005041 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:00.005005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:00.005490 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:00.005153    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:01.004872 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:01.004776    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:01.004872 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:01.004822    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:01.005089 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:01.004913    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:01.005372 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:01.005300    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:02.005248 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:02.005198    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:02.005841 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:02.005341    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:03.004902 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:03.004866    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:03.005064 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:03.005012    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:03.005122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:03.005061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:03.005179 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:03.005141    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:04.005039 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:04.004999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:04.005441 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:04.005146    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:05.005110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:05.005077    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:05.005490 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:05.005204    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:05.005593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:05.005566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:05.005732 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:05.005662    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:06.004792 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:06.004760    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:06.004977 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.004898    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:06.589059 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:06.589023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:06.589430 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:06.589072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:06.589430 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.589170    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:08:06.589430 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.589214    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:08:06.589430 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.589247    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret podName:e9fa5013-f680-42b7-87a2-4c368f648a14 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:22.58922925 +0000 UTC m=+34.153682198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret") pod "global-pull-secret-syncer-bhjtq" (UID: "e9fa5013-f680-42b7-87a2-4c368f648a14") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:08:06.589430 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.589297    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs podName:6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:22.589274202 +0000 UTC m=+34.153727133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs") pod "network-metrics-daemon-sxmbj" (UID: "6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:08:06.689957 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:06.689910    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:06.690127 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.690091    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:08:06.690127 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.690115    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:08:06.690127 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.690128    2559 projected.go:196] Error preparing data for projected volume kube-api-access-zbh67 for pod openshift-network-diagnostics/network-check-target-j8rqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:08:06.690261 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:06.690193    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67 podName:13a74c44-28db-4ee5-aa0c-1919313defa3 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:22.690175347 +0000 UTC m=+34.254628280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbh67" (UniqueName: "kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67") pod "network-check-target-j8rqp" (UID: "13a74c44-28db-4ee5-aa0c-1919313defa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:08:07.005043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:07.004965    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:07.005198 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:07.004965    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:07.005198 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:07.005103    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:07.005198 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:07.005169    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:08.005102 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:08.005060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:08.005596 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:08.005173    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:09.007441 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:09.007414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:09.007867 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:09.007421    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:09.007867 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:09.007523    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:09.007867 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:09.007582    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:10.005097 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:10.005065    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:10.005269 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:10.005185    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:11.005135 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.004852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:11.005725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.004902    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:11.005725 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:11.005260    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:11.005725 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:11.005296    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:11.136002 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.135971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ln7s8" event={"ID":"65fb6704-d388-47d9-b29b-c69c04bb0f11","Type":"ContainerStarted","Data":"36490517413e6d5d69e01c1eaa503c34c845309ce7ebbebf57f46838c8739003"}
Jul 29 00:08:11.137961 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.137945    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:08:11.138312 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.138289    2559 generic.go:356] "Generic (PLEG): container finished" podID="95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c" containerID="4e89ddcfae7ef735da0c26d0da8f08a4cd7df0ac4a647f07cae43a08b46ee2a5" exitCode=1
Jul 29 00:08:11.138378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.138361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"cedb72a12f2f5bb598707e2116f595411996a6237794718ac11ddc4276913064"}
Jul 29 00:08:11.138462 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.138442    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerDied","Data":"4e89ddcfae7ef735da0c26d0da8f08a4cd7df0ac4a647f07cae43a08b46ee2a5"}
Jul 29 00:08:11.138559 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.138500    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"aac65a44b9a8dcc4d6f21d1c1870fc2b370197cdcf8dbed41f274841f7a15f28"}
Jul 29 00:08:11.139804 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.139781    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6fbtp" event={"ID":"0d023894-c69b-42ef-8eb8-ec818b0957d2","Type":"ContainerStarted","Data":"80f2154696e984328f41d75b42f202fca2159ac218ebe6ab7b9fce8a2f80d413"}
Jul 29 00:08:11.141459 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.141439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ww9p9" event={"ID":"84061f31-807c-4245-adb1-8ac55c66d1ac","Type":"ContainerStarted","Data":"b20ff4f50eb1ba3f0c74650aa30520bd97e8bf06651c4e4c477fe8abca1b5ee9"}
Jul 29 00:08:11.142896 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.142878    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt" event={"ID":"d00dead9-ed29-4e34-bff5-2210ea44ccd9","Type":"ContainerStarted","Data":"de3f267bb630b8ff089a160436158d7baf34aa912d108f6546fb6e37d5a0ba8c"}
Jul 29 00:08:11.144372 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.144351    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sp27m" event={"ID":"917bb460-051d-4d25-b8d9-bdd84ee6a2d4","Type":"ContainerStarted","Data":"8064127a7632a1c9bf08ebd176f2ba14258f382037190c9c44a2f2229b16f8e2"}
Jul 29 00:08:11.146521 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.146224    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4r45s" event={"ID":"dd528d51-9db8-40fd-a06c-7b382f9c6393","Type":"ContainerStarted","Data":"d7f7a5999246c35923870ed7324601abbb1abd9c6c350b4fbac025671326ee10"}
Jul 29 00:08:11.147875 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.147852    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb" containerID="a53c94e222309f477a47d2929092c48d30f2bb1322d25f689012b22148b97f83" exitCode=0
Jul 29 00:08:11.147980 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.147883    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" event={"ID":"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb","Type":"ContainerDied","Data":"a53c94e222309f477a47d2929092c48d30f2bb1322d25f689012b22148b97f83"}
Jul 29 00:08:11.158251 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.158200    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6fbtp" podStartSLOduration=7.663105225 podStartE2EDuration="22.158179944s" totalImagesPullingTime="14.495074719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:11.157549541 +0000 UTC m=+22.722002495" watchObservedRunningTime="2026-07-29 00:08:11.158179944 +0000 UTC m=+22.722632897"
Jul 29 00:08:11.158452 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.158428    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-68.ec2.internal" podStartSLOduration=21.158420498 podStartE2EDuration="21.158420498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:07:54.115244623 +0000 UTC m=+5.679697580" watchObservedRunningTime="2026-07-29 00:08:11.158420498 +0000 UTC m=+22.722873452"
Jul 29 00:08:11.186765 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.186726    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4r45s" podStartSLOduration=3.6131294990000002 podStartE2EDuration="22.186712051s" totalImagesPullingTime="18.573582552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:11.186688126 +0000 UTC m=+22.751141075" watchObservedRunningTime="2026-07-29 00:08:11.186712051 +0000 UTC m=+22.751165003"
Jul 29 00:08:11.186863 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.186798    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ln7s8" podStartSLOduration=3.616512168 podStartE2EDuration="22.186792465s" totalImagesPullingTime="18.570280297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:11.171933635 +0000 UTC m=+22.736386587" watchObservedRunningTime="2026-07-29 00:08:11.186792465 +0000 UTC m=+22.751245416"
Jul 29 00:08:11.212448 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.212327    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sp27m" podStartSLOduration=3.63625244 podStartE2EDuration="22.212312482s" totalImagesPullingTime="18.576060042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:11.206818097 +0000 UTC m=+22.771271052" watchObservedRunningTime="2026-07-29 00:08:11.212312482 +0000 UTC m=+22.776765433"
Jul 29 00:08:11.250741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:11.250702    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ww9p9" podStartSLOduration=3.594943408 podStartE2EDuration="22.250685638s" totalImagesPullingTime="18.65574223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:11.250634875 +0000 UTC m=+22.815087827" watchObservedRunningTime="2026-07-29 00:08:11.250685638 +0000 UTC m=+22.815138584"
Jul 29 00:08:12.005013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:12.004935    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:12.005209 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:12.005075    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:12.152157 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:12.152117    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hbcz5" event={"ID":"f17b3342-f2d9-4d7c-be38-74d1580f30a1","Type":"ContainerStarted","Data":"8d7f060af36b2d53ff9288838345dc3c83bfec51ac3e6b632b1069db780a917c"}
Jul 29 00:08:12.155512 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:12.155489    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:08:12.156357 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:12.155875    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"e423fd38024f0244d2757b01954dd5cfd8a139100f12d052d909f619899dd553"}
Jul 29 00:08:12.156357 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:12.155959    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"584f46aa07757dce856b778efa65946a069d7978d6f78bc16cb8394b5d9c64a0"}
Jul 29 00:08:12.156357 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:12.156010    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"4474445f9e1ef7d12fdc2803bf48f1f81cb9c26292ae10c3c6982d9295101bab"}
Jul 29 00:08:12.166177 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:12.166139    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hbcz5" podStartSLOduration=4.589551749 podStartE2EDuration="23.166125394s" totalImagesPullingTime="18.576573645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:12.165874181 +0000 UTC m=+23.730327134" watchObservedRunningTime="2026-07-29 00:08:12.166125394 +0000 UTC m=+23.730578346"
Jul 29 00:08:13.004891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:13.004854    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:13.005044 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:13.005005    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:13.005130 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:13.005055    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:13.005189 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:13.005167    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:13.063890 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:13.063864    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 00:08:13.159783 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:13.159747    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt" event={"ID":"d00dead9-ed29-4e34-bff5-2210ea44ccd9","Type":"ContainerStarted","Data":"cba4e1f3ac00eb70cbeefd759cad83875ba7b10b906da8ddbd25062da2f97762"}
Jul 29 00:08:13.927803 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:13.927723    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T00:08:13.063884626Z","UUID":"628b5f70-68a7-4d23-9390-427f270e8fbb","Handler":null,"Name":"","Endpoint":""}
Jul 29 00:08:13.930103 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:13.930083    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 00:08:13.930244 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:13.930127    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 00:08:14.005012 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:14.004981    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:14.005156 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:14.005092    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:14.166211 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:14.166146    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:08:14.166602 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:14.166529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"5bdc1e216119e5a5f3e994412cc5b70679310df3c435dae0edaef809133a2667"}
Jul 29 00:08:14.715203 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:14.715167    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:08:14.715802 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:14.715777    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:08:15.005386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:15.005298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:15.005386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:15.005331    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:15.005552 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:15.005425    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:15.005552 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:15.005539    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:15.169338 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:15.169307    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:08:15.169786 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:15.169771    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6fbtp"
Jul 29 00:08:16.005245 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.005016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:16.005380 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:16.005284    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:16.173882 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.173853    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:08:16.174638 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.174205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"826e77c9f35e8d97bc66032fad3293075340468e95065c04ef4ea8cc18af7d86"}
Jul 29 00:08:16.174638 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.174443    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:08:16.174638 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.174504    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:08:16.174638 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.174584    2559 scope.go:117] "RemoveContainer" containerID="4e89ddcfae7ef735da0c26d0da8f08a4cd7df0ac4a647f07cae43a08b46ee2a5"
Jul 29 00:08:16.176588 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.176551    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt" event={"ID":"d00dead9-ed29-4e34-bff5-2210ea44ccd9","Type":"ContainerStarted","Data":"83d0d1de84544a43c154f223f7f55cc27d4e43b9b2741190dd6a5f583bae2898"}
Jul 29 00:08:16.178534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.178510    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb" containerID="a1628d75fe437a07720c650422a055277636601902d398da8e51323361ea5f94" exitCode=0
Jul 29 00:08:16.178626 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.178576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" event={"ID":"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb","Type":"ContainerDied","Data":"a1628d75fe437a07720c650422a055277636601902d398da8e51323361ea5f94"}
Jul 29 00:08:16.191696 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.191656    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:08:16.259891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:16.259816    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k75nt" podStartSLOduration=4.233865052 podStartE2EDuration="27.25980176s" totalImagesPullingTime="23.025936708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:16.233239505 +0000 UTC m=+27.797692456" watchObservedRunningTime="2026-07-29 00:08:16.25980176 +0000 UTC m=+27.824254703"
Jul 29 00:08:17.005198 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.005012    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:17.005310 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.005003    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:17.005310 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:17.005280    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:17.005439 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:17.005415    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:17.183643 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.183608    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb" containerID="e97b80957e726a216e2390a2fb02deb98a07a35a7c6ac5e36aecb4c90f0e8cab" exitCode=0
Jul 29 00:08:17.184027 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.183703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" event={"ID":"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb","Type":"ContainerDied","Data":"e97b80957e726a216e2390a2fb02deb98a07a35a7c6ac5e36aecb4c90f0e8cab"}
Jul 29 00:08:17.187785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.187765    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:08:17.188209 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.188179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" event={"ID":"95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c","Type":"ContainerStarted","Data":"b4d127904d9a8a1d488577d31d0f983969d9c91954c3a43600c23954b0f1003c"}
Jul 29 00:08:17.188438 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.188419    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:08:17.203616 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.203596    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:08:17.234111 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.234010    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh" podStartSLOduration=9.62461514 podStartE2EDuration="28.233994454s" totalImagesPullingTime="18.609379314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:17.232433678 +0000 UTC m=+28.796886629" watchObservedRunningTime="2026-07-29 00:08:17.233994454 +0000 UTC m=+28.798447406"
Jul 29 00:08:17.584170 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.584090    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bhjtq"]
Jul 29 00:08:17.584351 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.584206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:17.584351 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:17.584313    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:17.587425 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.587375    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j8rqp"]
Jul 29 00:08:17.587547 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.587479    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:17.587614 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:17.587572    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:17.588005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.587983    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sxmbj"]
Jul 29 00:08:17.588115 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:17.588084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:17.588183 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:17.588165    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:18.193176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:18.193141    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb" containerID="ff68c26e112ffe9ecb7b0f932153171cbca790c578040f79a925a0a09db23319" exitCode=0
Jul 29 00:08:18.193760 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:18.193194    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" event={"ID":"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb","Type":"ContainerDied","Data":"ff68c26e112ffe9ecb7b0f932153171cbca790c578040f79a925a0a09db23319"}
Jul 29 00:08:19.008133 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:19.008103    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:19.008333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:19.008212    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:19.008333 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:19.008217    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:19.008333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:19.008246    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:19.008473 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:19.008333    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:19.008473 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:19.008431    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:21.004683 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:21.004629    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:21.005131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:21.004634    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:21.005131 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:21.004791    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:21.005131 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:21.004851    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:21.005131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:21.004642    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:21.005131 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:21.004958    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:22.606564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:22.606382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:22.606564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:22.606570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:22.607102 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:22.606533    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:08:22.607102 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:22.606654    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 00:08:22.607102 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:22.606718    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret podName:e9fa5013-f680-42b7-87a2-4c368f648a14 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:54.606704504 +0000 UTC m=+66.171157433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret") pod "global-pull-secret-syncer-bhjtq" (UID: "e9fa5013-f680-42b7-87a2-4c368f648a14") : object "kube-system"/"original-pull-secret" not registered
Jul 29 00:08:22.607102 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:22.606731    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs podName:6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:54.606724525 +0000 UTC m=+66.171177454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs") pod "network-metrics-daemon-sxmbj" (UID: "6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 00:08:22.706951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:22.706918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:22.707099 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:22.707057    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 00:08:22.707099 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:22.707072    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 00:08:22.707099 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:22.707081    2559 projected.go:196] Error preparing data for projected volume kube-api-access-zbh67 for pod openshift-network-diagnostics/network-check-target-j8rqp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:08:22.707204 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:22.707134    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67 podName:13a74c44-28db-4ee5-aa0c-1919313defa3 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:54.707120455 +0000 UTC m=+66.271573385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbh67" (UniqueName: "kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67") pod "network-check-target-j8rqp" (UID: "13a74c44-28db-4ee5-aa0c-1919313defa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 00:08:23.005010 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.004980    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:23.005165 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:23.005090    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-j8rqp" podUID="13a74c44-28db-4ee5-aa0c-1919313defa3"
Jul 29 00:08:23.005165 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.005123    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:23.005232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.004981    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:23.005232 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:23.005211    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sxmbj" podUID="6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3"
Jul 29 00:08:23.005351 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:23.005326    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bhjtq" podUID="e9fa5013-f680-42b7-87a2-4c368f648a14"
Jul 29 00:08:23.209243 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.209210    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb" containerID="d75e233ca22ce792eb40d33aaca844f3b3c83a05b1382b12efcc54f6473c6aed" exitCode=0
Jul 29 00:08:23.209443 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.209261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" event={"ID":"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb","Type":"ContainerDied","Data":"d75e233ca22ce792eb40d33aaca844f3b3c83a05b1382b12efcc54f6473c6aed"}
Jul 29 00:08:23.691680 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.691651    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-68.ec2.internal" event="NodeReady"
Jul 29 00:08:23.692182 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.691765    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 00:08:23.723782 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.723757    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"]
Jul 29 00:08:23.742648 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.742620    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"]
Jul 29 00:08:23.742797 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.742661    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rjl6p"]
Jul 29 00:08:23.742797 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.742750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.745519 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.745501    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 00:08:23.745644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.745525    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 00:08:23.745728 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.745657    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 00:08:23.745785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.745770    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qq8mm\""
Jul 29 00:08:23.760614 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.758790    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 00:08:23.762314 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.762295    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k55nr"]
Jul 29 00:08:23.762420 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.762405    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:23.765156 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.765137    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 00:08:23.765235 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.765141    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wvlt2\""
Jul 29 00:08:23.765235 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.765178    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 00:08:23.784706 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.784687    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k55nr"]
Jul 29 00:08:23.784796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.784756    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rjl6p"]
Jul 29 00:08:23.784847 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.784828    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k55nr"
Jul 29 00:08:23.787347 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.787332    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 00:08:23.787543 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.787529    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jmk87\""
Jul 29 00:08:23.787596 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.787543    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 00:08:23.787596 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.787585    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 00:08:23.816644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.816625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-bound-sa-token\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.816746 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.816661    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nww9j\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-kube-api-access-nww9j\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.816746 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.816695    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.816746 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.816712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da5cd444-9a48-4be6-add1-b0b337700071-ca-trust-extracted\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.816846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.816777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-registry-certificates\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.816846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.816802    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-trusted-ca\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.816846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.816820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-image-registry-private-configuration\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.816846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.816836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-installation-pull-secrets\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.868378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.868349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:23.917430 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75vlt\" (UniqueName: \"kubernetes.io/projected/42c31a85-105c-40f6-91a8-1df2bed84e4a-kube-api-access-75vlt\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:23.917699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42c31a85-105c-40f6-91a8-1df2bed84e4a-config-volume\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:23.917699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917453    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:23.917699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42c31a85-105c-40f6-91a8-1df2bed84e4a-tmp-dir\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:23.917699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63c265d6-d0f4-47b0-990b-88ecf99a457b-cert\") pod \"ingress-canary-k55nr\" (UID: \"63c265d6-d0f4-47b0-990b-88ecf99a457b\") " pod="openshift-ingress-canary/ingress-canary-k55nr"
Jul 29 00:08:23.917699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-bound-sa-token\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.917699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917610    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nww9j\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-kube-api-access-nww9j\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.917699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpjsb\" (UniqueName: \"kubernetes.io/projected/63c265d6-d0f4-47b0-990b-88ecf99a457b-kube-api-access-rpjsb\") pod \"ingress-canary-k55nr\" (UID: \"63c265d6-d0f4-47b0-990b-88ecf99a457b\") " pod="openshift-ingress-canary/ingress-canary-k55nr"
Jul 29 00:08:23.917699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.918100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da5cd444-9a48-4be6-add1-b0b337700071-ca-trust-extracted\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.918100 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:23.917751    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 00:08:23.918100 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:23.917764    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m: secret "image-registry-tls" not found
Jul 29 00:08:23.918100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-registry-certificates\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.918100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-trusted-ca\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.918100 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:23.917813    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls podName:da5cd444-9a48-4be6-add1-b0b337700071 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:24.417794684 +0000 UTC m=+35.982247630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls") pod "image-registry-5bfdf6f7fc-7sd6m" (UID: "da5cd444-9a48-4be6-add1-b0b337700071") : secret "image-registry-tls" not found
Jul 29 00:08:23.918100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-image-registry-private-configuration\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.918100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.917873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-installation-pull-secrets\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.918498 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.918112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da5cd444-9a48-4be6-add1-b0b337700071-ca-trust-extracted\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.918498 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.918348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-registry-certificates\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.918699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.918656    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-trusted-ca\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.921702 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.921680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-installation-pull-secrets\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.921702 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.921688    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-image-registry-private-configuration\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.927540 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.927513    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nww9j\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-kube-api-access-nww9j\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.928141 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.928121    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-bound-sa-token\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:23.952020 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:23.951961    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:24.018099 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.018073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75vlt\" (UniqueName: \"kubernetes.io/projected/42c31a85-105c-40f6-91a8-1df2bed84e4a-kube-api-access-75vlt\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:24.018195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.018104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42c31a85-105c-40f6-91a8-1df2bed84e4a-config-volume\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:24.018195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.018120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:24.018195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.018156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42c31a85-105c-40f6-91a8-1df2bed84e4a-tmp-dir\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:24.018195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.018179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63c265d6-d0f4-47b0-990b-88ecf99a457b-cert\") pod \"ingress-canary-k55nr\" (UID: \"63c265d6-d0f4-47b0-990b-88ecf99a457b\") " pod="openshift-ingress-canary/ingress-canary-k55nr"
Jul 29 00:08:24.018388 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:24.018226    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 00:08:24.018388 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:24.018288    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls podName:42c31a85-105c-40f6-91a8-1df2bed84e4a nodeName:}" failed. No retries permitted until 2026-07-29 00:08:24.518268979 +0000 UTC m=+36.082721913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls") pod "dns-default-rjl6p" (UID: "42c31a85-105c-40f6-91a8-1df2bed84e4a") : secret "dns-default-metrics-tls" not found
Jul 29 00:08:24.018388 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.018228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpjsb\" (UniqueName: \"kubernetes.io/projected/63c265d6-d0f4-47b0-990b-88ecf99a457b-kube-api-access-rpjsb\") pod \"ingress-canary-k55nr\" (UID: \"63c265d6-d0f4-47b0-990b-88ecf99a457b\") " pod="openshift-ingress-canary/ingress-canary-k55nr"
Jul 29 00:08:24.018547 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.018519    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42c31a85-105c-40f6-91a8-1df2bed84e4a-tmp-dir\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:24.018691 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.018649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/42c31a85-105c-40f6-91a8-1df2bed84e4a-config-volume\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:24.020446 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.020430    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63c265d6-d0f4-47b0-990b-88ecf99a457b-cert\") pod \"ingress-canary-k55nr\" (UID: \"63c265d6-d0f4-47b0-990b-88ecf99a457b\") " pod="openshift-ingress-canary/ingress-canary-k55nr"
Jul 29 00:08:24.029250 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.029226    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpjsb\" (UniqueName: \"kubernetes.io/projected/63c265d6-d0f4-47b0-990b-88ecf99a457b-kube-api-access-rpjsb\") pod \"ingress-canary-k55nr\" (UID: \"63c265d6-d0f4-47b0-990b-88ecf99a457b\") " pod="openshift-ingress-canary/ingress-canary-k55nr"
Jul 29 00:08:24.029468 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.029451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75vlt\" (UniqueName: \"kubernetes.io/projected/42c31a85-105c-40f6-91a8-1df2bed84e4a-kube-api-access-75vlt\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:24.092740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.092720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k55nr"
Jul 29 00:08:24.215439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.215362    2559 generic.go:356] "Generic (PLEG): container finished" podID="2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb" containerID="ee35072e1fecd166132109b0f591746f0d8762e88bd59f54deb9b34753bccb48" exitCode=0
Jul 29 00:08:24.215439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.215432    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" event={"ID":"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb","Type":"ContainerDied","Data":"ee35072e1fecd166132109b0f591746f0d8762e88bd59f54deb9b34753bccb48"}
Jul 29 00:08:24.263863 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.263833    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k55nr"]
Jul 29 00:08:24.267360 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:24.267332    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c265d6_d0f4_47b0_990b_88ecf99a457b.slice/crio-3b133e0faa796839bffc7bf2fa8370f1334924421c8a9eab0696f96ed6e7711e WatchSource:0}: Error finding container 3b133e0faa796839bffc7bf2fa8370f1334924421c8a9eab0696f96ed6e7711e: Status 404 returned error can't find the container with id 3b133e0faa796839bffc7bf2fa8370f1334924421c8a9eab0696f96ed6e7711e
Jul 29 00:08:24.421893 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.421863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:24.422033 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:24.421996    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 00:08:24.422033 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:24.422012    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m: secret "image-registry-tls" not found
Jul 29 00:08:24.422111 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:24.422059    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls podName:da5cd444-9a48-4be6-add1-b0b337700071 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:25.422043743 +0000 UTC m=+36.986496675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls") pod "image-registry-5bfdf6f7fc-7sd6m" (UID: "da5cd444-9a48-4be6-add1-b0b337700071") : secret "image-registry-tls" not found
Jul 29 00:08:24.522472 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.522398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:24.522579 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:24.522492    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 00:08:24.522579 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:24.522532    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls podName:42c31a85-105c-40f6-91a8-1df2bed84e4a nodeName:}" failed. No retries permitted until 2026-07-29 00:08:25.522519714 +0000 UTC m=+37.086972644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls") pod "dns-default-rjl6p" (UID: "42c31a85-105c-40f6-91a8-1df2bed84e4a") : secret "dns-default-metrics-tls" not found
Jul 29 00:08:24.839997 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.839903    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:24.939988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:24.939957    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:25.002332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.002305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:25.005208 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.005189    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:25.005293 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.005190    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:25.005369 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.005192    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:25.009267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.009246    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 00:08:25.009470 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.009437    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 00:08:25.009470 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.009445    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdg8h\""
Jul 29 00:08:25.009634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.009460    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-thdv6\""
Jul 29 00:08:25.009634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.009492    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 00:08:25.009634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.009475    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 00:08:25.067621 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.067602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:25.132839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.132814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:25.190551 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.190514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:25.218886 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.218859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k55nr" event={"ID":"63c265d6-d0f4-47b0-990b-88ecf99a457b","Type":"ContainerStarted","Data":"3b133e0faa796839bffc7bf2fa8370f1334924421c8a9eab0696f96ed6e7711e"}
Jul 29 00:08:25.222750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.222727    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" event={"ID":"2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb","Type":"ContainerStarted","Data":"9ccd0d6f1d2c1bb2f16eb21fc05efa44af3284185313fa7f41c7ab1c35c0c457"}
Jul 29 00:08:25.245241 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.245189    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zf2fm" podStartSLOduration=7.209654304 podStartE2EDuration="36.245176172s" totalImagesPullingTime="29.035521868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:25.243751378 +0000 UTC m=+36.808204327" watchObservedRunningTime="2026-07-29 00:08:25.245176172 +0000 UTC m=+36.809629124"
Jul 29 00:08:25.429813 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.429744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:25.430066 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:25.429854    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 00:08:25.430066 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:25.429866    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m: secret "image-registry-tls" not found
Jul 29 00:08:25.430066 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:25.429926    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls podName:da5cd444-9a48-4be6-add1-b0b337700071 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:27.429909273 +0000 UTC m=+38.994362205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls") pod "image-registry-5bfdf6f7fc-7sd6m" (UID: "da5cd444-9a48-4be6-add1-b0b337700071") : secret "image-registry-tls" not found
Jul 29 00:08:25.530458 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.530428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:25.530695 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:25.530592    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 00:08:25.530695 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:25.530653    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls podName:42c31a85-105c-40f6-91a8-1df2bed84e4a nodeName:}" failed. No retries permitted until 2026-07-29 00:08:27.530636945 +0000 UTC m=+39.095089875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls") pod "dns-default-rjl6p" (UID: "42c31a85-105c-40f6-91a8-1df2bed84e4a") : secret "dns-default-metrics-tls" not found
Jul 29 00:08:25.835022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.834937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:25.926070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:25.926027    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:26.195176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:26.195152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:26.296111 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:26.296075    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:26.996984 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:26.996947    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:27.098252 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:27.098222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:27.404708 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:27.404684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:27.446148 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:27.446113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:27.446320 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:27.446297    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 00:08:27.446361 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:27.446325    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m: secret "image-registry-tls" not found
Jul 29 00:08:27.446403 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:27.446393    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls podName:da5cd444-9a48-4be6-add1-b0b337700071 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:31.446373428 +0000 UTC m=+43.010826361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls") pod "image-registry-5bfdf6f7fc-7sd6m" (UID: "da5cd444-9a48-4be6-add1-b0b337700071") : secret "image-registry-tls" not found
Jul 29 00:08:27.508596 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:27.508557    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:27.547090 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:27.547047    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:27.547255 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:27.547214    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 00:08:27.547296 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:27.547275    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls podName:42c31a85-105c-40f6-91a8-1df2bed84e4a nodeName:}" failed. No retries permitted until 2026-07-29 00:08:31.547258421 +0000 UTC m=+43.111711351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls") pod "dns-default-rjl6p" (UID: "42c31a85-105c-40f6-91a8-1df2bed84e4a") : secret "dns-default-metrics-tls" not found
Jul 29 00:08:28.231150 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:28.230929    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k55nr" event={"ID":"63c265d6-d0f4-47b0-990b-88ecf99a457b","Type":"ContainerStarted","Data":"3819b61b825bac6976dde9d90fe5e4714a877332fbde4198f029fa1067f13906"}
Jul 29 00:08:28.232640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:28.232615    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:28.246988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:28.246946    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k55nr" podStartSLOduration=2.210450211 podStartE2EDuration="5.246929384s" totalImagesPullingTime="3.036479173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:28.246892857 +0000 UTC m=+39.811345810" watchObservedRunningTime="2026-07-29 00:08:28.246929384 +0000 UTC m=+39.811382337"
Jul 29 00:08:28.329258 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:28.329220    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:28.600044 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:28.599963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:28.717440 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:28.717402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:29.183457 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:29.183434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:29.239053 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:29.239022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:29.401833 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:29.401798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:29.468501 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:29.468421    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:29.795838 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:29.795765    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:29.897404 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:29.897372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:31.133386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:31.133354    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:31.472344 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:31.472271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:31.472481 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:31.472423    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 00:08:31.472481 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:31.472441    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m: secret "image-registry-tls" not found
Jul 29 00:08:31.472548 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:31.472497    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls podName:da5cd444-9a48-4be6-add1-b0b337700071 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:39.472481421 +0000 UTC m=+51.036934351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls") pod "image-registry-5bfdf6f7fc-7sd6m" (UID: "da5cd444-9a48-4be6-add1-b0b337700071") : secret "image-registry-tls" not found
Jul 29 00:08:31.572851 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:31.572825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:31.572979 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:31.572963    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 00:08:31.573027 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:31.573017    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls podName:42c31a85-105c-40f6-91a8-1df2bed84e4a nodeName:}" failed. No retries permitted until 2026-07-29 00:08:39.57300418 +0000 UTC m=+51.137457110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls") pod "dns-default-rjl6p" (UID: "42c31a85-105c-40f6-91a8-1df2bed84e4a") : secret "dns-default-metrics-tls" not found
Jul 29 00:08:33.601569 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:33.601533    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:33.702749 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:33.702724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:34.575317 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.575287    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"]
Jul 29 00:08:34.597264 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.597241    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"]
Jul 29 00:08:34.597386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.597359    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:34.600872 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.600852    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 00:08:34.601091 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.601072    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 00:08:34.601558 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.601543    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pgkd9\""
Jul 29 00:08:34.608851 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.608834    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"]
Jul 29 00:08:34.609098 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.608859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"]
Jul 29 00:08:34.609098 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.608918    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.612791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.612776    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 00:08:34.612877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.612815    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g5r4b\""
Jul 29 00:08:34.613378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.613364    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 00:08:34.613442 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.613399    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 00:08:34.618068 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.618051    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 00:08:34.675478 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.675446    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b"]
Jul 29 00:08:34.682882 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.682858    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"]
Jul 29 00:08:34.683041 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.682993    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b"
Jul 29 00:08:34.687267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.687198    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4j5dz\""
Jul 29 00:08:34.692783 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.692740    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s8kkw"]
Jul 29 00:08:34.693060 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.693001    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.695782 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.695758    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 29 00:08:34.695885 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.695786    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:08:34.695885 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.695769    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5v4x8\""
Jul 29 00:08:34.695885 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.695803    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 29 00:08:34.695885 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.695816    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 29 00:08:34.696352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.696332    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:34.696439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.696355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncq5k\" (UniqueName: \"kubernetes.io/projected/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-kube-api-access-ncq5k\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.696439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.696382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.696439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.696398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.696552 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.696445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:34.702852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.702832    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"]
Jul 29 00:08:34.702981 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.702965    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.705444 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.705425    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 00:08:34.705544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.705521    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 00:08:34.705544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.705524    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-frvkw\""
Jul 29 00:08:34.705787 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.705774    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:08:34.705865 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.705851    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 00:08:34.710916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.710900    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5969697cd7-882cd"]
Jul 29 00:08:34.711038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.710933    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 00:08:34.711038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.711016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:34.713818 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.713800    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 00:08:34.714041 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.714027    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8p7lv\""
Jul 29 00:08:34.714113 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.714059    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 00:08:34.714154 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.714138    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:08:34.718968 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.718952    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b"]
Jul 29 00:08:34.719055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.718978    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"]
Jul 29 00:08:34.719055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.718992    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s8kkw"]
Jul 29 00:08:34.719055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.719006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"]
Jul 29 00:08:34.719055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.719022    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5969697cd7-882cd"]
Jul 29 00:08:34.719184 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.719069    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.721501 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.721482    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 00:08:34.721501 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.721497    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 00:08:34.721698 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.721555    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 00:08:34.721698 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.721582    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 00:08:34.721698 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.721637    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 00:08:34.721986 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.721970    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 00:08:34.722052 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.722039    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-49p5m\""
Jul 29 00:08:34.781694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.781617    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"]
Jul 29 00:08:34.795223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.795197    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"]
Jul 29 00:08:34.795347 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.795277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:34.797740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.797714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03bce739-ff56-4615-9fb1-4d99917f33e4-config\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.797898 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.797756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:34.797898 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.797815    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03bce739-ff56-4615-9fb1-4d99917f33e4-trusted-ca\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.797898 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.797870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.798141 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.797909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwgqh\" (UniqueName: \"kubernetes.io/projected/0db69871-87a8-4c88-8375-8d91aff8b186-kube-api-access-jwgqh\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.798141 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.797934    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.798141 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.797969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqp4t\" (UniqueName: \"kubernetes.io/projected/2dc574ee-27d9-4ffd-b469-89ed6a500fd4-kube-api-access-wqp4t\") pod \"network-check-source-7d88cb55d8-l8j7b\" (UID: \"2dc574ee-27d9-4ffd-b469-89ed6a500fd4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b"
Jul 29 00:08:34.798141 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798082    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03bce739-ff56-4615-9fb1-4d99917f33e4-serving-cert\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.798403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798149    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:34.798403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798200    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.798403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798215    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:08:34.798403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-default-certificate\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.798403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798279    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.798403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0db69871-87a8-4c88-8375-8d91aff8b186-config\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.798403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:34.798403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0db69871-87a8-4c88-8375-8d91aff8b186-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.798728 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz7qd\" (UniqueName: \"kubernetes.io/projected/03bce739-ff56-4615-9fb1-4d99917f33e4-kube-api-access-xz7qd\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.798811 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798791    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wkp6b\""
Jul 29 00:08:34.798970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798949    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 00:08:34.799030 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.798964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tf4c\" (UniqueName: \"kubernetes.io/projected/ab369058-4fb0-464f-94bb-2c987511f3db-kube-api-access-4tf4c\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.799076 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.799051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-stats-auth\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.799134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.799079    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 00:08:34.799196 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.799130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lggvn\" (UniqueName: \"kubernetes.io/projected/a9472feb-b6c5-4407-ab89-bad384a438b1-kube-api-access-lggvn\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:34.799196 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.799142    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:34.799281 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.799197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncq5k\" (UniqueName: \"kubernetes.io/projected/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-kube-api-access-ncq5k\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.799579 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.799556    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls podName:5cfe8332-ab5b-49a9-ac64-8af5a9de0224 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:35.299530959 +0000 UTC m=+46.863983928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-qhdvt" (UID: "5cfe8332-ab5b-49a9-ac64-8af5a9de0224") : secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:34.799736 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.799717    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 00:08:34.799861 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.799790    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert podName:fb0f8b2e-7883-4c8d-82d9-948aca6056bc nodeName:}" failed. No retries permitted until 2026-07-29 00:08:35.299773258 +0000 UTC m=+46.864226204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-2l8pk" (UID: "fb0f8b2e-7883-4c8d-82d9-948aca6056bc") : secret "networking-console-plugin-cert" not found
Jul 29 00:08:34.800173 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.800147    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.800389 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.800363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:34.800497 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.800410    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 00:08:34.802051 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.802033    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277"]
Jul 29 00:08:34.816411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.816391    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hqssm"]
Jul 29 00:08:34.816506 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.816471    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277"
Jul 29 00:08:34.819014 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.818995    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:08:34.819108 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.819019    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c8jlw\""
Jul 29 00:08:34.819108 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.819075    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 00:08:34.827309 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.827268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:34.828049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.828026    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncq5k\" (UniqueName: \"kubernetes.io/projected/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-kube-api-access-ncq5k\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:34.830657 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.830641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277"]
Jul 29 00:08:34.830746 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.830686    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hqssm"]
Jul 29 00:08:34.830786 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.830759    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:34.833431 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.833410    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 00:08:34.833527 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.833464    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 00:08:34.833527 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.833483    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tdcvt\""
Jul 29 00:08:34.833627 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.833548    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 00:08:34.833627 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.833550    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 00:08:34.839030 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.839013    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 00:08:34.879451 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.879425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:34.900420 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqp4t\" (UniqueName: \"kubernetes.io/projected/2dc574ee-27d9-4ffd-b469-89ed6a500fd4-kube-api-access-wqp4t\") pod \"network-check-source-7d88cb55d8-l8j7b\" (UID: \"2dc574ee-27d9-4ffd-b469-89ed6a500fd4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b"
Jul 29 00:08:34.900505 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03bce739-ff56-4615-9fb1-4d99917f33e4-serving-cert\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.900505 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-tmp\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:34.900505 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb692481-489c-4ad6-8e06-26230cca2236-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:34.900654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-default-certificate\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.900654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0db69871-87a8-4c88-8375-8d91aff8b186-config\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.900654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:34.900654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0db69871-87a8-4c88-8375-8d91aff8b186-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.900654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-snapshots\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz7qd\" (UniqueName: \"kubernetes.io/projected/03bce739-ff56-4615-9fb1-4d99917f33e4-kube-api-access-xz7qd\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tf4c\" (UniqueName: \"kubernetes.io/projected/ab369058-4fb0-464f-94bb-2c987511f3db-kube-api-access-4tf4c\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.900753    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-stats-auth\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.900811    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls podName:a9472feb-b6c5-4407-ab89-bad384a438b1 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:35.4007933 +0000 UTC m=+46.965246229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls") pod "cluster-samples-operator-6748489656-nc8zn" (UID: "a9472feb-b6c5-4407-ab89-bad384a438b1") : secret "samples-operator-tls" not found
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900833    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900867    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb692481-489c-4ad6-8e06-26230cca2236-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lggvn\" (UniqueName: \"kubernetes.io/projected/a9472feb-b6c5-4407-ab89-bad384a438b1-kube-api-access-lggvn\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpddc\" (UniqueName: \"kubernetes.io/projected/cb692481-489c-4ad6-8e06-26230cca2236-kube-api-access-rpddc\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:34.900988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.900991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03bce739-ff56-4615-9fb1-4d99917f33e4-config\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901057    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-service-ca-bundle\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901088    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0db69871-87a8-4c88-8375-8d91aff8b186-config\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnpm\" (UniqueName: \"kubernetes.io/projected/582bfba0-ce13-4268-9002-f4eeba32c98d-kube-api-access-qvnpm\") pod \"volume-data-source-validator-549c6d54cf-zf277\" (UID: \"582bfba0-ce13-4268-9002-f4eeba32c98d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03bce739-ff56-4615-9fb1-4d99917f33e4-trusted-ca\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-428gp\" (UniqueName: \"kubernetes.io/projected/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-kube-api-access-428gp\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwgqh\" (UniqueName: \"kubernetes.io/projected/0db69871-87a8-4c88-8375-8d91aff8b186-kube-api-access-jwgqh\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.901295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-serving-cert\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.901415    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:35.401399764 +0000 UTC m=+46.965852696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : configmap references non-existent config key: service-ca.crt
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.901416    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 00:08:34.901644 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:34.901470    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:35.401457653 +0000 UTC m=+46.965910583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : secret "router-metrics-certs-default" not found
Jul 29 00:08:34.902258 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.902237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03bce739-ff56-4615-9fb1-4d99917f33e4-config\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.902380 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.902362    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/03bce739-ff56-4615-9fb1-4d99917f33e4-trusted-ca\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.903059 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.903042    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0db69871-87a8-4c88-8375-8d91aff8b186-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.903370 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.903351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-default-certificate\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.903512 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.903493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03bce739-ff56-4615-9fb1-4d99917f33e4-serving-cert\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.903590 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.903577    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-stats-auth\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.910612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.910588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwgqh\" (UniqueName: \"kubernetes.io/projected/0db69871-87a8-4c88-8375-8d91aff8b186-kube-api-access-jwgqh\") pod \"service-ca-operator-5d6c75f84f-ghcvp\" (UID: \"0db69871-87a8-4c88-8375-8d91aff8b186\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:34.910805 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.910739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lggvn\" (UniqueName: \"kubernetes.io/projected/a9472feb-b6c5-4407-ab89-bad384a438b1-kube-api-access-lggvn\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:34.910805 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.910769    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqp4t\" (UniqueName: \"kubernetes.io/projected/2dc574ee-27d9-4ffd-b469-89ed6a500fd4-kube-api-access-wqp4t\") pod \"network-check-source-7d88cb55d8-l8j7b\" (UID: \"2dc574ee-27d9-4ffd-b469-89ed6a500fd4\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b"
Jul 29 00:08:34.910985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.910865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz7qd\" (UniqueName: \"kubernetes.io/projected/03bce739-ff56-4615-9fb1-4d99917f33e4-kube-api-access-xz7qd\") pod \"console-operator-584dcb6b54-s8kkw\" (UID: \"03bce739-ff56-4615-9fb1-4d99917f33e4\") " pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:34.911199 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.911179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tf4c\" (UniqueName: \"kubernetes.io/projected/ab369058-4fb0-464f-94bb-2c987511f3db-kube-api-access-4tf4c\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:34.995588 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:34.995562    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b"
Jul 29 00:08:35.001914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.001892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-service-ca-bundle\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.001982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.001925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnpm\" (UniqueName: \"kubernetes.io/projected/582bfba0-ce13-4268-9002-f4eeba32c98d-kube-api-access-qvnpm\") pod \"volume-data-source-validator-549c6d54cf-zf277\" (UID: \"582bfba0-ce13-4268-9002-f4eeba32c98d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277"
Jul 29 00:08:35.001982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.001968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-428gp\" (UniqueName: \"kubernetes.io/projected/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-kube-api-access-428gp\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.002065 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002010    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-serving-cert\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.002065 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-tmp\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.002165 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb692481-489c-4ad6-8e06-26230cca2236-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:35.002216 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002172    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-snapshots\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.002349 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.002411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb692481-489c-4ad6-8e06-26230cca2236-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:35.002461 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpddc\" (UniqueName: \"kubernetes.io/projected/cb692481-489c-4ad6-8e06-26230cca2236-kube-api-access-rpddc\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:35.002461 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-tmp\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.002576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-service-ca-bundle\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.002833 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002812    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-snapshots\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.002982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.002942    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cb692481-489c-4ad6-8e06-26230cca2236-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:35.003217 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.003197    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.004362 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.004339    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-serving-cert\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.004460 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.004443    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cb692481-489c-4ad6-8e06-26230cca2236-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:35.005414 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.005399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"
Jul 29 00:08:35.012017 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.011991    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpddc\" (UniqueName: \"kubernetes.io/projected/cb692481-489c-4ad6-8e06-26230cca2236-kube-api-access-rpddc\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m\" (UID: \"cb692481-489c-4ad6-8e06-26230cca2236\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:35.012541 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.012517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnpm\" (UniqueName: \"kubernetes.io/projected/582bfba0-ce13-4268-9002-f4eeba32c98d-kube-api-access-qvnpm\") pod \"volume-data-source-validator-549c6d54cf-zf277\" (UID: \"582bfba0-ce13-4268-9002-f4eeba32c98d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277"
Jul 29 00:08:35.012681 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.012647    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:35.031979 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.029865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-428gp\" (UniqueName: \"kubernetes.io/projected/c5c41fee-02ba-4fa3-9969-ced6c7d1f860-kube-api-access-428gp\") pod \"insights-operator-5885fdb759-hqssm\" (UID: \"c5c41fee-02ba-4fa3-9969-ced6c7d1f860\") " pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.108458 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.108292    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"
Jul 29 00:08:35.125211 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.125145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277"
Jul 29 00:08:35.140704 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.140651    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hqssm"
Jul 29 00:08:35.169434 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.169363    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b"]
Jul 29 00:08:35.173939 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:35.173904    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc574ee_27d9_4ffd_b469_89ed6a500fd4.slice/crio-0fcbaf27f9d58342b2a8bc8bc60ed52bd8375a4ef957d23f01b312b999365599 WatchSource:0}: Error finding container 0fcbaf27f9d58342b2a8bc8bc60ed52bd8375a4ef957d23f01b312b999365599: Status 404 returned error can't find the container with id 0fcbaf27f9d58342b2a8bc8bc60ed52bd8375a4ef957d23f01b312b999365599
Jul 29 00:08:35.212684 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.212577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp"]
Jul 29 00:08:35.221002 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:35.220939    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db69871_87a8_4c88_8375_8d91aff8b186.slice/crio-aedb0761cc6ccaf5123277538024e7c4f89a9d38b2635e2fddb2434c9bb62d50 WatchSource:0}: Error finding container aedb0761cc6ccaf5123277538024e7c4f89a9d38b2635e2fddb2434c9bb62d50: Status 404 returned error can't find the container with id aedb0761cc6ccaf5123277538024e7c4f89a9d38b2635e2fddb2434c9bb62d50
Jul 29 00:08:35.239783 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.239696    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-s8kkw"]
Jul 29 00:08:35.243209 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:35.243175    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bce739_ff56_4615_9fb1_4d99917f33e4.slice/crio-c267569614c2f9e9a0ac853e1eb1e786462662c614b376cbaed873d82525b206 WatchSource:0}: Error finding container c267569614c2f9e9a0ac853e1eb1e786462662c614b376cbaed873d82525b206: Status 404 returned error can't find the container with id c267569614c2f9e9a0ac853e1eb1e786462662c614b376cbaed873d82525b206
Jul 29 00:08:35.251495 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.251456    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" event={"ID":"03bce739-ff56-4615-9fb1-4d99917f33e4","Type":"ContainerStarted","Data":"c267569614c2f9e9a0ac853e1eb1e786462662c614b376cbaed873d82525b206"}
Jul 29 00:08:35.252716 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.252690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b" event={"ID":"2dc574ee-27d9-4ffd-b469-89ed6a500fd4","Type":"ContainerStarted","Data":"0fcbaf27f9d58342b2a8bc8bc60ed52bd8375a4ef957d23f01b312b999365599"}
Jul 29 00:08:35.253931 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.253902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp" event={"ID":"0db69871-87a8-4c88-8375-8d91aff8b186","Type":"ContainerStarted","Data":"aedb0761cc6ccaf5123277538024e7c4f89a9d38b2635e2fddb2434c9bb62d50"}
Jul 29 00:08:35.300649 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.300618    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m"]
Jul 29 00:08:35.303930 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:35.303900    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb692481_489c_4ad6_8e06_26230cca2236.slice/crio-4ce9b2d7ee6854b64f4abf10307813463dc7f789fe5e764aec6bc79de82126d2 WatchSource:0}: Error finding container 4ce9b2d7ee6854b64f4abf10307813463dc7f789fe5e764aec6bc79de82126d2: Status 404 returned error can't find the container with id 4ce9b2d7ee6854b64f4abf10307813463dc7f789fe5e764aec6bc79de82126d2
Jul 29 00:08:35.306187 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.306158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:35.306253 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.306223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:35.306735 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.306334    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 00:08:35.306735 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.306347    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:35.306735 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.306410    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls podName:5cfe8332-ab5b-49a9-ac64-8af5a9de0224 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:36.306380534 +0000 UTC m=+47.870833463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-qhdvt" (UID: "5cfe8332-ab5b-49a9-ac64-8af5a9de0224") : secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:35.306735 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.306451    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert podName:fb0f8b2e-7883-4c8d-82d9-948aca6056bc nodeName:}" failed. No retries permitted until 2026-07-29 00:08:36.30642539 +0000 UTC m=+47.870878327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-2l8pk" (UID: "fb0f8b2e-7883-4c8d-82d9-948aca6056bc") : secret "networking-console-plugin-cert" not found
Jul 29 00:08:35.315201 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.315179    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277"]
Jul 29 00:08:35.329996 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:35.329973    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod582bfba0_ce13_4268_9002_f4eeba32c98d.slice/crio-0cb601755fe700ad03165f2511c1b10a086761a0cdec8a8bd97759af73460777 WatchSource:0}: Error finding container 0cb601755fe700ad03165f2511c1b10a086761a0cdec8a8bd97759af73460777: Status 404 returned error can't find the container with id 0cb601755fe700ad03165f2511c1b10a086761a0cdec8a8bd97759af73460777
Jul 29 00:08:35.345360 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.345293    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hqssm"]
Jul 29 00:08:35.347398 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:35.347379    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c41fee_02ba_4fa3_9969_ced6c7d1f860.slice/crio-5dfd4bdd6642d3bc8827e837bbe8a30cb38f8fe8bbea51b7a62fb9c8b25ec66b WatchSource:0}: Error finding container 5dfd4bdd6642d3bc8827e837bbe8a30cb38f8fe8bbea51b7a62fb9c8b25ec66b: Status 404 returned error can't find the container with id 5dfd4bdd6642d3bc8827e837bbe8a30cb38f8fe8bbea51b7a62fb9c8b25ec66b
Jul 29 00:08:35.407277 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.407244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:35.407413 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.407293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:35.407413 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:35.407375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:35.407519 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.407405    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 00:08:35.407519 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.407462    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:36.407447298 +0000 UTC m=+47.971900228 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : secret "router-metrics-certs-default" not found
Jul 29 00:08:35.407519 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.407482    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:36.407473008 +0000 UTC m=+47.971925938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : configmap references non-existent config key: service-ca.crt
Jul 29 00:08:35.407519 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.407503    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 00:08:35.407709 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:35.407570    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls podName:a9472feb-b6c5-4407-ab89-bad384a438b1 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:36.407553199 +0000 UTC m=+47.972006133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls") pod "cluster-samples-operator-6748489656-nc8zn" (UID: "a9472feb-b6c5-4407-ab89-bad384a438b1") : secret "samples-operator-tls" not found
Jul 29 00:08:36.260733 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:36.260602    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277" event={"ID":"582bfba0-ce13-4268-9002-f4eeba32c98d","Type":"ContainerStarted","Data":"0cb601755fe700ad03165f2511c1b10a086761a0cdec8a8bd97759af73460777"}
Jul 29 00:08:36.264199 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:36.264081    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hqssm" event={"ID":"c5c41fee-02ba-4fa3-9969-ced6c7d1f860","Type":"ContainerStarted","Data":"5dfd4bdd6642d3bc8827e837bbe8a30cb38f8fe8bbea51b7a62fb9c8b25ec66b"}
Jul 29 00:08:36.266762 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:36.266710    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m" event={"ID":"cb692481-489c-4ad6-8e06-26230cca2236","Type":"ContainerStarted","Data":"4ce9b2d7ee6854b64f4abf10307813463dc7f789fe5e764aec6bc79de82126d2"}
Jul 29 00:08:36.315771 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:36.314816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:36.315771 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:36.314878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:36.315771 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.315086    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:36.315771 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.315148    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls podName:5cfe8332-ab5b-49a9-ac64-8af5a9de0224 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:38.315129391 +0000 UTC m=+49.879582329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-qhdvt" (UID: "5cfe8332-ab5b-49a9-ac64-8af5a9de0224") : secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:36.315771 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.315681    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 00:08:36.315771 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.315735    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert podName:fb0f8b2e-7883-4c8d-82d9-948aca6056bc nodeName:}" failed. No retries permitted until 2026-07-29 00:08:38.315718724 +0000 UTC m=+49.880171657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-2l8pk" (UID: "fb0f8b2e-7883-4c8d-82d9-948aca6056bc") : secret "networking-console-plugin-cert" not found
Jul 29 00:08:36.416534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:36.415772    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:36.416534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:36.415834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:36.416534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:36.415924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:36.416534 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.416114    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 00:08:36.416534 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.416186    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls podName:a9472feb-b6c5-4407-ab89-bad384a438b1 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:38.416167406 +0000 UTC m=+49.980620336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls") pod "cluster-samples-operator-6748489656-nc8zn" (UID: "a9472feb-b6c5-4407-ab89-bad384a438b1") : secret "samples-operator-tls" not found
Jul 29 00:08:36.416534 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.416247    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 00:08:36.416534 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.416290    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:38.416276379 +0000 UTC m=+49.980729311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : secret "router-metrics-certs-default" not found
Jul 29 00:08:36.416534 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:36.416317    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:38.416297024 +0000 UTC m=+49.980749976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : configmap references non-existent config key: service-ca.crt
Jul 29 00:08:38.334699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:38.334640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:38.335184 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:38.334731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:38.335184 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.334806    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 00:08:38.335184 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.334847    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:38.335184 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.334893    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert podName:fb0f8b2e-7883-4c8d-82d9-948aca6056bc nodeName:}" failed. No retries permitted until 2026-07-29 00:08:42.334873433 +0000 UTC m=+53.899326363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-2l8pk" (UID: "fb0f8b2e-7883-4c8d-82d9-948aca6056bc") : secret "networking-console-plugin-cert" not found
Jul 29 00:08:38.335184 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.334914    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls podName:5cfe8332-ab5b-49a9-ac64-8af5a9de0224 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:42.33490453 +0000 UTC m=+53.899357460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-qhdvt" (UID: "5cfe8332-ab5b-49a9-ac64-8af5a9de0224") : secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:38.436048 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:38.436004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:38.436234 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:38.436068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:38.436234 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.436134    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 00:08:38.436234 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:38.436156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:38.436234 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.436208    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:42.436188157 +0000 UTC m=+54.000641109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : secret "router-metrics-certs-default" not found
Jul 29 00:08:38.436436 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.436233    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:42.436216496 +0000 UTC m=+54.000669429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : configmap references non-existent config key: service-ca.crt
Jul 29 00:08:38.436436 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.436263    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 00:08:38.436436 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:38.436315    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls podName:a9472feb-b6c5-4407-ab89-bad384a438b1 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:42.43630169 +0000 UTC m=+54.000754626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls") pod "cluster-samples-operator-6748489656-nc8zn" (UID: "a9472feb-b6c5-4407-ab89-bad384a438b1") : secret "samples-operator-tls" not found
Jul 29 00:08:39.546291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:39.546248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:39.546653 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:39.546402    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 00:08:39.546653 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:39.546421    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m: secret "image-registry-tls" not found
Jul 29 00:08:39.546653 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:39.546484    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls podName:da5cd444-9a48-4be6-add1-b0b337700071 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:55.546461763 +0000 UTC m=+67.110914692 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls") pod "image-registry-5bfdf6f7fc-7sd6m" (UID: "da5cd444-9a48-4be6-add1-b0b337700071") : secret "image-registry-tls" not found
Jul 29 00:08:39.647734 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:39.647701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:39.647902 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:39.647865    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 00:08:39.647964 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:39.647952    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls podName:42c31a85-105c-40f6-91a8-1df2bed84e4a nodeName:}" failed. No retries permitted until 2026-07-29 00:08:55.647929586 +0000 UTC m=+67.212382537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls") pod "dns-default-rjl6p" (UID: "42c31a85-105c-40f6-91a8-1df2bed84e4a") : secret "dns-default-metrics-tls" not found
Jul 29 00:08:40.421111 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:40.421078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:40.472738 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:40.472703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:42.292920 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.292881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp" event={"ID":"0db69871-87a8-4c88-8375-8d91aff8b186","Type":"ContainerStarted","Data":"2732038a14e296e8a3307799ceebcf2ac8bf7f82a656906d22f991b2785fd421"}
Jul 29 00:08:42.294522 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.294492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277" event={"ID":"582bfba0-ce13-4268-9002-f4eeba32c98d","Type":"ContainerStarted","Data":"fd10fcc1c801d02578023c90f27093975119a2da6a1b98a01c9d9350958ea25b"}
Jul 29 00:08:42.296194 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.296173    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/0.log"
Jul 29 00:08:42.296298 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.296215    2559 generic.go:356] "Generic (PLEG): container finished" podID="03bce739-ff56-4615-9fb1-4d99917f33e4" containerID="880cd6af770e0db9fbfb54a7cb35493b599c63554c5787e201b465c2fa9fc60f" exitCode=255
Jul 29 00:08:42.296298 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.296264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" event={"ID":"03bce739-ff56-4615-9fb1-4d99917f33e4","Type":"ContainerDied","Data":"880cd6af770e0db9fbfb54a7cb35493b599c63554c5787e201b465c2fa9fc60f"}
Jul 29 00:08:42.296567 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.296539    2559 scope.go:117] "RemoveContainer" containerID="880cd6af770e0db9fbfb54a7cb35493b599c63554c5787e201b465c2fa9fc60f"
Jul 29 00:08:42.298728 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.298699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hqssm" event={"ID":"c5c41fee-02ba-4fa3-9969-ced6c7d1f860","Type":"ContainerStarted","Data":"4ffb205b45960bf9db068fd468edf1cfde927818d6ac1e9692e2b572393bf355"}
Jul 29 00:08:42.300328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.300300    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b" event={"ID":"2dc574ee-27d9-4ffd-b469-89ed6a500fd4","Type":"ContainerStarted","Data":"5654cbb1bf9be402fbe614f007d2eab2feb67f8855361cf475cd384b632d1803"}
Jul 29 00:08:42.301750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.301729    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m" event={"ID":"cb692481-489c-4ad6-8e06-26230cca2236","Type":"ContainerStarted","Data":"4784497f4a00d45fe469dc735bfda6a9d6518a1842c295f00a16e071d933683a"}
Jul 29 00:08:42.313655 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.313608    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp" podStartSLOduration=2.020679894 podStartE2EDuration="8.313591435s" totalImagesPullingTime="6.292911541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:42.312529135 +0000 UTC m=+53.876982092" watchObservedRunningTime="2026-07-29 00:08:42.313591435 +0000 UTC m=+53.878044384"
Jul 29 00:08:42.350138 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.350072    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-l8j7b" podStartSLOduration=2.004670135 podStartE2EDuration="8.350052639s" totalImagesPullingTime="6.345382504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:42.332692405 +0000 UTC m=+53.897145352" watchObservedRunningTime="2026-07-29 00:08:42.350052639 +0000 UTC m=+53.914505596"
Jul 29 00:08:42.350295 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.350213    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m" podStartSLOduration=2.139683631 podStartE2EDuration="8.350208151s" totalImagesPullingTime="6.21052452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:42.349766929 +0000 UTC m=+53.914219882" watchObservedRunningTime="2026-07-29 00:08:42.350208151 +0000 UTC m=+53.914661108"
Jul 29 00:08:42.369588 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.369536    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-zf277" podStartSLOduration=2.18596048 podStartE2EDuration="8.369516176s" totalImagesPullingTime="6.183555696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:42.369063825 +0000 UTC m=+53.933516779" watchObservedRunningTime="2026-07-29 00:08:42.369516176 +0000 UTC m=+53.933969140"
Jul 29 00:08:42.375082 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.374832    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:42.375082 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.374897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:42.375082 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.375005    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 00:08:42.375082 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.375074    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert podName:fb0f8b2e-7883-4c8d-82d9-948aca6056bc nodeName:}" failed. No retries permitted until 2026-07-29 00:08:50.375054458 +0000 UTC m=+61.939507399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-2l8pk" (UID: "fb0f8b2e-7883-4c8d-82d9-948aca6056bc") : secret "networking-console-plugin-cert" not found
Jul 29 00:08:42.375642 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.375622    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:42.375730 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.375720    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls podName:5cfe8332-ab5b-49a9-ac64-8af5a9de0224 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:50.375686231 +0000 UTC m=+61.940139168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-qhdvt" (UID: "5cfe8332-ab5b-49a9-ac64-8af5a9de0224") : secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:42.405403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.405351    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-hqssm" podStartSLOduration=2.242225439 podStartE2EDuration="8.405329135s" totalImagesPullingTime="6.163103696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:42.404433087 +0000 UTC m=+53.968886041" watchObservedRunningTime="2026-07-29 00:08:42.405329135 +0000 UTC m=+53.969782088"
Jul 29 00:08:42.477593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.476070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:42.477593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.476156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:42.477593 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.476199    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 00:08:42.477593 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.476262    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:50.476242483 +0000 UTC m=+62.040695433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : secret "router-metrics-certs-default" not found
Jul 29 00:08:42.477593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.476345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:42.477593 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.476937    2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 00:08:42.477593 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.476988    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls podName:a9472feb-b6c5-4407-ab89-bad384a438b1 nodeName:}" failed. No retries permitted until 2026-07-29 00:08:50.476971587 +0000 UTC m=+62.041424519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls") pod "cluster-samples-operator-6748489656-nc8zn" (UID: "a9472feb-b6c5-4407-ab89-bad384a438b1") : secret "samples-operator-tls" not found
Jul 29 00:08:42.477593 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:42.477354    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:08:50.477334255 +0000 UTC m=+62.041787192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : configmap references non-existent config key: service-ca.crt
Jul 29 00:08:42.506039 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.506014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:42.605869 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.605783    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:42.795741 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.795713    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8wgqx"]
Jul 29 00:08:42.797849 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.797831    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:42.813603 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.813582    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 00:08:42.815024 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.815005    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 00:08:42.817107 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.817089    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gmgkv\""
Jul 29 00:08:42.821830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.821810    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8wgqx"]
Jul 29 00:08:42.897851 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.897810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:42.982345 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.982307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0b9f511-d540-4446-af02-fa758f2e10ac-crio-socket\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:42.982345 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.982342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:42.982574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.982377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:42.982574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.982458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0b9f511-d540-4446-af02-fa758f2e10ac-data-volume\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:42.982703 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:42.982607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmh2n\" (UniqueName: \"kubernetes.io/projected/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-api-access-wmh2n\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.029036 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.028997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:43.083066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.083033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0b9f511-d540-4446-af02-fa758f2e10ac-crio-socket\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.083066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.083064    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.083291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.083086    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.083291 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.083152    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 00:08:43.083291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.083158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0b9f511-d540-4446-af02-fa758f2e10ac-crio-socket\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.083291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.083200    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0b9f511-d540-4446-af02-fa758f2e10ac-data-volume\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.083291 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.083219    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:43.583197714 +0000 UTC m=+55.147650664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : configmap "kube-rbac-proxy" not found
Jul 29 00:08:43.083291 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.083265    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:43.083583 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.083339    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:43.583327486 +0000 UTC m=+55.147780417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:43.083583 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.083356    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmh2n\" (UniqueName: \"kubernetes.io/projected/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-api-access-wmh2n\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.083583 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.083503    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0b9f511-d540-4446-af02-fa758f2e10ac-data-volume\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.092219 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.092199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmh2n\" (UniqueName: \"kubernetes.io/projected/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-api-access-wmh2n\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.125613 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.125583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:43.307432 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.307363    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:08:43.307788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.307763    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/0.log"
Jul 29 00:08:43.307827 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.307793    2559 generic.go:356] "Generic (PLEG): container finished" podID="03bce739-ff56-4615-9fb1-4d99917f33e4" containerID="d149570ed96ea9951d08d39e8a8e6e1cb4e76284c2d4f17ed014c016fcd940d0" exitCode=255
Jul 29 00:08:43.307929 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.307897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" event={"ID":"03bce739-ff56-4615-9fb1-4d99917f33e4","Type":"ContainerDied","Data":"d149570ed96ea9951d08d39e8a8e6e1cb4e76284c2d4f17ed014c016fcd940d0"}
Jul 29 00:08:43.308057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.307956    2559 scope.go:117] "RemoveContainer" containerID="880cd6af770e0db9fbfb54a7cb35493b599c63554c5787e201b465c2fa9fc60f"
Jul 29 00:08:43.308137 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.308120    2559 scope.go:117] "RemoveContainer" containerID="d149570ed96ea9951d08d39e8a8e6e1cb4e76284c2d4f17ed014c016fcd940d0"
Jul 29 00:08:43.308335 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.308312    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s8kkw_openshift-console-operator(03bce739-ff56-4615-9fb1-4d99917f33e4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" podUID="03bce739-ff56-4615-9fb1-4d99917f33e4"
Jul 29 00:08:43.423217 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.423154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:43.480582 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.480546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:43.588933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.588856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.588933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.588889    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:43.589119 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.588971    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 00:08:43.589119 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.588986    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:43.589119 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.589039    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:44.589022614 +0000 UTC m=+56.153475561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:43.589119 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:43.589106    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:44.589087898 +0000 UTC m=+56.153540828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : configmap "kube-rbac-proxy" not found
Jul 29 00:08:43.875505 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.875475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:43.975203 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:43.975164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:44.141320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.141236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:44.192580 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.192554    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4r45s_dd528d51-9db8-40fd-a06c-7b382f9c6393/dns-node-resolver/0.log"
Jul 29 00:08:44.238272 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.238241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:44.311924 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.311900    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:08:44.312313 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.312211    2559 scope.go:117] "RemoveContainer" containerID="d149570ed96ea9951d08d39e8a8e6e1cb4e76284c2d4f17ed014c016fcd940d0"
Jul 29 00:08:44.312363 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:44.312348    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s8kkw_openshift-console-operator(03bce739-ff56-4615-9fb1-4d99917f33e4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" podUID="03bce739-ff56-4615-9fb1-4d99917f33e4"
Jul 29 00:08:44.398157 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.398064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:44.454447 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.454411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:44.597680 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.597634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:44.597840 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:44.597707    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:44.597840 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:44.597754    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 00:08:44.597840 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:44.597818    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:46.597802437 +0000 UTC m=+58.162255371 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : configmap "kube-rbac-proxy" not found
Jul 29 00:08:44.598047 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:44.597861    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:44.598047 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:44.597938    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:46.5979195 +0000 UTC m=+58.162372451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:45.013003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.012971    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:45.013156 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.013025    2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:45.054548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.054514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:45.155094 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.155061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:45.315185 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.315106    2559 scope.go:117] "RemoveContainer" containerID="d149570ed96ea9951d08d39e8a8e6e1cb4e76284c2d4f17ed014c016fcd940d0"
Jul 29 00:08:45.315521 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:45.315270    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s8kkw_openshift-console-operator(03bce739-ff56-4615-9fb1-4d99917f33e4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" podUID="03bce739-ff56-4615-9fb1-4d99917f33e4"
Jul 29 00:08:45.392147 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.392120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ln7s8_65fb6704-d388-47d9-b29b-c69c04bb0f11/node-ca/0.log"
Jul 29 00:08:45.764900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.764862    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:45.817039 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.817011    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:45.992727 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:45.992700    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k55nr_63c265d6-d0f4-47b0-990b-88ecf99a457b/serve-healthcheck-canary/0.log"
Jul 29 00:08:46.233297 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:46.233255    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:46.318711 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:46.318662    2559 scope.go:117] "RemoveContainer" containerID="d149570ed96ea9951d08d39e8a8e6e1cb4e76284c2d4f17ed014c016fcd940d0"
Jul 29 00:08:46.319057 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:46.318836    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-s8kkw_openshift-console-operator(03bce739-ff56-4615-9fb1-4d99917f33e4)\"" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" podUID="03bce739-ff56-4615-9fb1-4d99917f33e4"
Jul 29 00:08:46.330058 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:46.330010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:46.605050 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:46.604976    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:46.616159 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:46.616129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:46.616276 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:46.616174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:46.616276 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:46.616241    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 00:08:46.616356 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:46.616304    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:50.616289882 +0000 UTC m=+62.180742812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : configmap "kube-rbac-proxy" not found
Jul 29 00:08:46.616356 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:46.616338    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:46.616445 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:46.616390    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:50.616374891 +0000 UTC m=+62.180827821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:49.206983 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:49.206953    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4htfh"
Jul 29 00:08:49.758259 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:49.758228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:50.171170 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.171120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:50.361711 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.361662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:50.450842 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.450753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:08:50.450842 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.450793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:08:50.451057 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.450908    2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:50.451057 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.450913    2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 00:08:50.451057 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.450957    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls podName:5cfe8332-ab5b-49a9-ac64-8af5a9de0224 nodeName:}" failed. No retries permitted until 2026-07-29 00:09:06.45094489 +0000 UTC m=+78.015397819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-qhdvt" (UID: "5cfe8332-ab5b-49a9-ac64-8af5a9de0224") : secret "cluster-monitoring-operator-tls" not found
Jul 29 00:08:50.451057 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.450971    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert podName:fb0f8b2e-7883-4c8d-82d9-948aca6056bc nodeName:}" failed. No retries permitted until 2026-07-29 00:09:06.450964116 +0000 UTC m=+78.015417046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-2l8pk" (UID: "fb0f8b2e-7883-4c8d-82d9-948aca6056bc") : secret "networking-console-plugin-cert" not found
Jul 29 00:08:50.462707 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.462662    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:50.552040 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.552002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:50.552163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.552080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:50.552163 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.552154    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:09:06.552134524 +0000 UTC m=+78.116587456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : configmap references non-existent config key: service-ca.crt
Jul 29 00:08:50.552252 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.552208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:08:50.552316 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.552301    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 00:08:50.552357 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.552349    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs podName:ab369058-4fb0-464f-94bb-2c987511f3db nodeName:}" failed. No retries permitted until 2026-07-29 00:09:06.552337312 +0000 UTC m=+78.116790242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs") pod "router-default-5969697cd7-882cd" (UID: "ab369058-4fb0-464f-94bb-2c987511f3db") : secret "router-metrics-certs-default" not found
Jul 29 00:08:50.554534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.554515    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a9472feb-b6c5-4407-ab89-bad384a438b1-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-nc8zn\" (UID: \"a9472feb-b6c5-4407-ab89-bad384a438b1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:50.563274 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.563254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:50.621800 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.621776    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8p7lv\""
Jul 29 00:08:50.629002 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.628985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"
Jul 29 00:08:50.652938 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.652901    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:50.653050 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.652951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:50.653050 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.653017    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 00:08:50.653155 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.653082    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:58.653062238 +0000 UTC m=+70.217515175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : configmap "kube-rbac-proxy" not found
Jul 29 00:08:50.653155 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.653111    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:50.653263 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:50.653166    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:08:58.653154096 +0000 UTC m=+70.217607025 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:50.678356 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.678293    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:50.753780 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.753716    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn"]
Jul 29 00:08:50.756879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.756850    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:50.821954 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:50.821935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:51.335739 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:51.335704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn" event={"ID":"a9472feb-b6c5-4407-ab89-bad384a438b1","Type":"ContainerStarted","Data":"a62c7aaeac30b36fa9e3b09e5c48a15bd4e754ab9640d0cdc5edc137547f63ab"}
Jul 29 00:08:51.585213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:51.585178    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:51.977864 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:51.977815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:52.175986 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:52.175954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:52.572450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:52.572418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:53.176943 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:53.176912    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:53.346948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:53.346915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn" event={"ID":"a9472feb-b6c5-4407-ab89-bad384a438b1","Type":"ContainerStarted","Data":"0c1e6946d120aab3107e0350d8a26ffe98fcb9c06b6b6836430bcfc7ba9be9f3"}
Jul 29 00:08:53.347134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:53.346968    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn" event={"ID":"a9472feb-b6c5-4407-ab89-bad384a438b1","Type":"ContainerStarted","Data":"ee391509a355c585029ab0264150b17fa8ebcdea261fa79ae7a6c7df2bca9870"}
Jul 29 00:08:53.365043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:53.364995    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-nc8zn" podStartSLOduration=17.410226624 podStartE2EDuration="19.364980361s" totalImagesPullingTime="1.954753737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:53.364259159 +0000 UTC m=+64.928712110" watchObservedRunningTime="2026-07-29 00:08:53.364980361 +0000 UTC m=+64.929433314"
Jul 29 00:08:53.576413 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:53.576332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:53.864234 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:53.864152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:53.921226 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:53.921198    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:54.175340 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.175315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:54.224810 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.224781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:54.689369 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.689342    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:54.689527 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.689426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:08:54.692000 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.691982    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 00:08:54.692080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.692071    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 00:08:54.700103 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:54.700090    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 00:08:54.700187 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:54.700177    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs podName:6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3 nodeName:}" failed. No retries permitted until 2026-07-29 00:09:58.700162032 +0000 UTC m=+130.264614962 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs") pod "network-metrics-daemon-sxmbj" (UID: "6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3") : secret "metrics-daemon-secret" not found
Jul 29 00:08:54.702301 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.702276    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9fa5013-f680-42b7-87a2-4c368f648a14-original-pull-secret\") pod \"global-pull-secret-syncer-bhjtq\" (UID: \"e9fa5013-f680-42b7-87a2-4c368f648a14\") " pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:54.715487 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.715472    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bhjtq"
Jul 29 00:08:54.776962 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.776931    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:54.791267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.791174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:54.793826 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.793805    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbh67\" (UniqueName: \"kubernetes.io/projected/13a74c44-28db-4ee5-aa0c-1919313defa3-kube-api-access-zbh67\") pod \"network-check-target-j8rqp\" (UID: \"13a74c44-28db-4ee5-aa0c-1919313defa3\") " pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:54.844965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:54.844933    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bhjtq"]
Jul 29 00:08:54.847617 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:54.847592    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9fa5013_f680_42b7_87a2_4c368f648a14.slice/crio-914582c056dd1584f4a60121a806f306970a3563dbd904bf7b757f7215977ad0 WatchSource:0}: Error finding container 914582c056dd1584f4a60121a806f306970a3563dbd904bf7b757f7215977ad0: Status 404 returned error can't find the container with id 914582c056dd1584f4a60121a806f306970a3563dbd904bf7b757f7215977ad0
Jul 29 00:08:55.027346 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.027277    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pdg8h\""
Jul 29 00:08:55.035399 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.035382    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:55.180073 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.179929    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-j8rqp"]
Jul 29 00:08:55.182604 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:55.182574    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a74c44_28db_4ee5_aa0c_1919313defa3.slice/crio-369d2d1690e4d7cc2c28bccaa89ed91d715b4834f6157eec1434e203891983c3 WatchSource:0}: Error finding container 369d2d1690e4d7cc2c28bccaa89ed91d715b4834f6157eec1434e203891983c3: Status 404 returned error can't find the container with id 369d2d1690e4d7cc2c28bccaa89ed91d715b4834f6157eec1434e203891983c3
Jul 29 00:08:55.353948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.353920    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j8rqp" event={"ID":"13a74c44-28db-4ee5-aa0c-1919313defa3","Type":"ContainerStarted","Data":"fd2ae3285bfd9f38ef9335d35569f9dcb26a1245f5909ee53d7d07fac5702fee"}
Jul 29 00:08:55.354323 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.353970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-j8rqp" event={"ID":"13a74c44-28db-4ee5-aa0c-1919313defa3","Type":"ContainerStarted","Data":"369d2d1690e4d7cc2c28bccaa89ed91d715b4834f6157eec1434e203891983c3"}
Jul 29 00:08:55.354323 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.353998    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:08:55.355066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.355045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bhjtq" event={"ID":"e9fa5013-f680-42b7-87a2-4c368f648a14","Type":"ContainerStarted","Data":"914582c056dd1584f4a60121a806f306970a3563dbd904bf7b757f7215977ad0"}
Jul 29 00:08:55.370144 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.370098    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-j8rqp" podStartSLOduration=66.370084663 podStartE2EDuration="1m6.370084663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:55.368794655 +0000 UTC m=+66.933247607" watchObservedRunningTime="2026-07-29 00:08:55.370084663 +0000 UTC m=+66.934537614"
Jul 29 00:08:55.383034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.383008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:55.576392 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.576295    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:55.598332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.598299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:55.600989 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.600966    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"image-registry-5bfdf6f7fc-7sd6m\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") " pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:55.699183 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.699147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:55.701917 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.701893    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/42c31a85-105c-40f6-91a8-1df2bed84e4a-metrics-tls\") pod \"dns-default-rjl6p\" (UID: \"42c31a85-105c-40f6-91a8-1df2bed84e4a\") " pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:55.818084 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.818046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:55.854496 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.854417    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qq8mm\""
Jul 29 00:08:55.862720 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.862689    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:55.873248 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.873224    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wvlt2\""
Jul 29 00:08:55.881454 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.881415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:08:55.977644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:55.977362    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:56.014076 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.014049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"]
Jul 29 00:08:56.017839 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:56.017816    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5cd444_9a48_4be6_add1_b0b337700071.slice/crio-a7322d51cbc44440da8b5a518fe2376932c19cfecee0b692f2a5a7dafa0aa3b5 WatchSource:0}: Error finding container a7322d51cbc44440da8b5a518fe2376932c19cfecee0b692f2a5a7dafa0aa3b5: Status 404 returned error can't find the container with id a7322d51cbc44440da8b5a518fe2376932c19cfecee0b692f2a5a7dafa0aa3b5
Jul 29 00:08:56.031772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.031751    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rjl6p"]
Jul 29 00:08:56.033887 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:08:56.033863    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c31a85_105c_40f6_91a8_1df2bed84e4a.slice/crio-9817ab88cca6835d4da06f81949a0922eff9eb413f0418f99679ef7ca1acda6a WatchSource:0}: Error finding container 9817ab88cca6835d4da06f81949a0922eff9eb413f0418f99679ef7ca1acda6a: Status 404 returned error can't find the container with id 9817ab88cca6835d4da06f81949a0922eff9eb413f0418f99679ef7ca1acda6a
Jul 29 00:08:56.171065 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.171003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:56.357104 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.357070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:56.360159 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.360134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjl6p" event={"ID":"42c31a85-105c-40f6-91a8-1df2bed84e4a","Type":"ContainerStarted","Data":"9817ab88cca6835d4da06f81949a0922eff9eb413f0418f99679ef7ca1acda6a"}
Jul 29 00:08:56.361922 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.361898    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m" event={"ID":"da5cd444-9a48-4be6-add1-b0b337700071","Type":"ContainerStarted","Data":"e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5"}
Jul 29 00:08:56.362045 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.361939    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m" event={"ID":"da5cd444-9a48-4be6-add1-b0b337700071","Type":"ContainerStarted","Data":"a7322d51cbc44440da8b5a518fe2376932c19cfecee0b692f2a5a7dafa0aa3b5"}
Jul 29 00:08:56.386069 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.386007    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m" podStartSLOduration=67.385989193 podStartE2EDuration="1m7.385989193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:56.385248192 +0000 UTC m=+67.949701145" watchObservedRunningTime="2026-07-29 00:08:56.385989193 +0000 UTC m=+67.950442146"
Jul 29 00:08:56.775876 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.775843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:56.976277 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:56.976235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:57.369148 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:57.367764    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:08:57.390469 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:57.390432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:57.774506 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:57.774426    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:58.005772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.005746    2559 scope.go:117] "RemoveContainer" containerID="d149570ed96ea9951d08d39e8a8e6e1cb4e76284c2d4f17ed014c016fcd940d0"
Jul 29 00:08:58.103537 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.103502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:58.374513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.374489    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:08:58.374959 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.374626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" event={"ID":"03bce739-ff56-4615-9fb1-4d99917f33e4","Type":"ContainerStarted","Data":"42603543e3a2fcbdc843f6195b625d42fa5cb05289797ddf0d06c7d8811b3c37"}
Jul 29 00:08:58.375135 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.375118    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:58.381274 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.381250    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw"
Jul 29 00:08:58.409031 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.408973    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-s8kkw" podStartSLOduration=18.132346467 podStartE2EDuration="24.408951577s" totalImagesPullingTime="6.27660511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:08:58.407507105 +0000 UTC m=+69.971960058" watchObservedRunningTime="2026-07-29 00:08:58.408951577 +0000 UTC m=+69.973404529"
Jul 29 00:08:58.524541 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.524504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:58.642453 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.642372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:58.725819 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.725779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:58.725819 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.725841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:58.726075 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:58.726033    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:58.726146 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:08:58.726115    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls podName:a0b9f511-d540-4446-af02-fa758f2e10ac nodeName:}" failed. No retries permitted until 2026-07-29 00:09:14.726094864 +0000 UTC m=+86.290547797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8wgqx" (UID: "a0b9f511-d540-4446-af02-fa758f2e10ac") : secret "insights-runtime-extractor-tls" not found
Jul 29 00:08:58.726421 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.726389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0b9f511-d540-4446-af02-fa758f2e10ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:08:58.743310 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.743262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:58.843550 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.843510    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:58.892948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.892870    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:58.976405 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:58.976371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:59.200820 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:59.200733    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:59.253357 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:59.253321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:59.376418 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:59.376386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:59.594336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:59.594252    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:59.652078 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:59.652048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:08:59.979629 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:08:59.979591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:00.178133 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.178103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:00.382212 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.382182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:00.384057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.384026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bhjtq" event={"ID":"e9fa5013-f680-42b7-87a2-4c368f648a14","Type":"ContainerStarted","Data":"ca19e44e3bd4a7fad3b10fc4e3352276fc31048d529244cb454c9f337bb25e48"}
Jul 29 00:09:00.385811 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.385787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjl6p" event={"ID":"42c31a85-105c-40f6-91a8-1df2bed84e4a","Type":"ContainerStarted","Data":"c220ef56066161f442d758645483d3eddffcc92cdcc590f9f225d2bb934a985c"}
Jul 29 00:09:00.385930 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.385830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjl6p" event={"ID":"42c31a85-105c-40f6-91a8-1df2bed84e4a","Type":"ContainerStarted","Data":"54b1e6457cb5a6ced5b7ba2de732ae92e9f8f4ff2854d6192de8b9c774ac1fd3"}
Jul 29 00:09:00.385930 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.385921    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:09:00.400732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.400694    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bhjtq" podStartSLOduration=66.188069503 podStartE2EDuration="1m11.400660584s" totalImagesPullingTime="5.212591081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:00.40057771 +0000 UTC m=+71.965030663" watchObservedRunningTime="2026-07-29 00:09:00.400660584 +0000 UTC m=+71.965113536"
Jul 29 00:09:00.418228 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.418184    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rjl6p" podStartSLOduration=33.398222659 podStartE2EDuration="37.418170825s" totalImagesPullingTime="4.019948166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:00.417705077 +0000 UTC m=+71.982158030" watchObservedRunningTime="2026-07-29 00:09:00.418170825 +0000 UTC m=+71.982623776"
Jul 29 00:09:00.439323 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.439302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:00.631153 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.631119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:00.787996 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.787961    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:00.883092 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:00.883018    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:01.276753 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:01.276660    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:03.604011 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:03.603978    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:03.660972 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:03.660942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:06.492776 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.492738    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:09:06.493240 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.492783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:09:06.495262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.495227    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cfe8332-ab5b-49a9-ac64-8af5a9de0224-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-qhdvt\" (UID: \"5cfe8332-ab5b-49a9-ac64-8af5a9de0224\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:09:06.495352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.495298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fb0f8b2e-7883-4c8d-82d9-948aca6056bc-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-2l8pk\" (UID: \"fb0f8b2e-7883-4c8d-82d9-948aca6056bc\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:09:06.593827 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.593797    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:06.593974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.593834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:06.594368 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.594347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab369058-4fb0-464f-94bb-2c987511f3db-service-ca-bundle\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:06.596139 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.596118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab369058-4fb0-464f-94bb-2c987511f3db-metrics-certs\") pod \"router-default-5969697cd7-882cd\" (UID: \"ab369058-4fb0-464f-94bb-2c987511f3db\") " pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:06.708925 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.708896    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pgkd9\""
Jul 29 00:09:06.716322 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.716299    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"
Jul 29 00:09:06.718802 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.718785    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g5r4b\""
Jul 29 00:09:06.726423 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.726396    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"
Jul 29 00:09:06.830077 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.830041    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-49p5m\""
Jul 29 00:09:06.837578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.837558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:06.855534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.855506    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk"]
Jul 29 00:09:06.858400 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:06.858371    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb0f8b2e_7883_4c8d_82d9_948aca6056bc.slice/crio-5060c92ef6c30884cc40799c84b3d98908ae32835e2b5478c6e2edfbcbcad9a2 WatchSource:0}: Error finding container 5060c92ef6c30884cc40799c84b3d98908ae32835e2b5478c6e2edfbcbcad9a2: Status 404 returned error can't find the container with id 5060c92ef6c30884cc40799c84b3d98908ae32835e2b5478c6e2edfbcbcad9a2
Jul 29 00:09:06.875742 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.875717    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt"]
Jul 29 00:09:06.880636 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:06.880611    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfe8332_ab5b_49a9_ac64_8af5a9de0224.slice/crio-7c6afd0ac70dbca1f61bc386b992ff7c951f7f3904665ec4f43f0224726b781c WatchSource:0}: Error finding container 7c6afd0ac70dbca1f61bc386b992ff7c951f7f3904665ec4f43f0224726b781c: Status 404 returned error can't find the container with id 7c6afd0ac70dbca1f61bc386b992ff7c951f7f3904665ec4f43f0224726b781c
Jul 29 00:09:06.971402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:06.971370    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5969697cd7-882cd"]
Jul 29 00:09:06.974390 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:06.974367    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab369058_4fb0_464f_94bb_2c987511f3db.slice/crio-ca0dfdec109fae4e359bb517824b4bab333830fe8c7a36128d28a2d3c81f48d7 WatchSource:0}: Error finding container ca0dfdec109fae4e359bb517824b4bab333830fe8c7a36128d28a2d3c81f48d7: Status 404 returned error can't find the container with id ca0dfdec109fae4e359bb517824b4bab333830fe8c7a36128d28a2d3c81f48d7
Jul 29 00:09:07.410965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.410930    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5969697cd7-882cd" event={"ID":"ab369058-4fb0-464f-94bb-2c987511f3db","Type":"ContainerStarted","Data":"1c72297e4d807902750025b6f367c582f72b9bc92aee6ec6b472e9929ee46835"}
Jul 29 00:09:07.411134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.410983    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5969697cd7-882cd" event={"ID":"ab369058-4fb0-464f-94bb-2c987511f3db","Type":"ContainerStarted","Data":"ca0dfdec109fae4e359bb517824b4bab333830fe8c7a36128d28a2d3c81f48d7"}
Jul 29 00:09:07.412082 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.412064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt" event={"ID":"5cfe8332-ab5b-49a9-ac64-8af5a9de0224","Type":"ContainerStarted","Data":"7c6afd0ac70dbca1f61bc386b992ff7c951f7f3904665ec4f43f0224726b781c"}
Jul 29 00:09:07.413125 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.413105    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk" event={"ID":"fb0f8b2e-7883-4c8d-82d9-948aca6056bc","Type":"ContainerStarted","Data":"5060c92ef6c30884cc40799c84b3d98908ae32835e2b5478c6e2edfbcbcad9a2"}
Jul 29 00:09:07.433299 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.433241    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5969697cd7-882cd" podStartSLOduration=33.433225262 podStartE2EDuration="33.433225262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:07.430913958 +0000 UTC m=+78.995366909" watchObservedRunningTime="2026-07-29 00:09:07.433225262 +0000 UTC m=+78.997678192"
Jul 29 00:09:07.827455 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.827274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:07.838157 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.838128    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:07.840819 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.840799    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:07.879614 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:07.879544    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:08.416744 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:08.416711    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:08.417902 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:08.417879    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5969697cd7-882cd"
Jul 29 00:09:09.245425 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.245337    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:09.346022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.345988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:09.421328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.421297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt" event={"ID":"5cfe8332-ab5b-49a9-ac64-8af5a9de0224","Type":"ContainerStarted","Data":"6596df1f3e9367b3d0a3e9b84d77c934e95ac78698099500c9792afae0e12778"}
Jul 29 00:09:09.422826 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.422788    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk" event={"ID":"fb0f8b2e-7883-4c8d-82d9-948aca6056bc","Type":"ContainerStarted","Data":"bd4851bc9b9994621694bb0c06a292640f843c00ed2feee90d4b219a6185e3cf"}
Jul 29 00:09:09.441332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.441290    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-qhdvt" podStartSLOduration=33.373702663 podStartE2EDuration="35.441277746s" totalImagesPullingTime="2.067575083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:09.439092455 +0000 UTC m=+81.003545407" watchObservedRunningTime="2026-07-29 00:09:09.441277746 +0000 UTC m=+81.005730697"
Jul 29 00:09:09.444085 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.444061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:09.468071 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.467968    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-2l8pk" podStartSLOduration=33.382670119 podStartE2EDuration="35.467954147s" totalImagesPullingTime="2.085284028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:09.466434169 +0000 UTC m=+81.030887121" watchObservedRunningTime="2026-07-29 00:09:09.467954147 +0000 UTC m=+81.032407099"
Jul 29 00:09:09.550570 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.550517    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:09.634415 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.634375    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"]
Jul 29 00:09:09.638711 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.638688    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.641568 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.641545    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 00:09:09.641693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.641583    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 00:09:09.641693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.641591    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 00:09:09.641693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.641593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 29 00:09:09.652080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.652055    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"]
Jul 29 00:09:09.682065 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.682036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:09.720394 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.720368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-klusterlet-config\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.720589 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.720444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-tmp\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.720589 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.720505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnttv\" (UniqueName: \"kubernetes.io/projected/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-kube-api-access-jnttv\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.732296 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.732269    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"]
Jul 29 00:09:09.735358 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.735343    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"
Jul 29 00:09:09.738644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.738624    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4g2kg\""
Jul 29 00:09:09.738764 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.738728    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 00:09:09.749531 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.749512    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6995f5b4fd-9gpzr"]
Jul 29 00:09:09.752409 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.752393    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-scw7m"]
Jul 29 00:09:09.752521 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.752506    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.755298 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.755275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-scw7m"
Jul 29 00:09:09.757809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.757792    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 00:09:09.758619 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.758598    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"]
Jul 29 00:09:09.758790 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.758770    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 00:09:09.758890 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.758788    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 00:09:09.758890 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.758859    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-725br\""
Jul 29 00:09:09.758890 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.758877    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 00:09:09.759204 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.759185    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 00:09:09.759300 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.759205    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jxcb6\""
Jul 29 00:09:09.759300 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.759245    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 00:09:09.759714 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.759525    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 00:09:09.771988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.771968    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-scw7m"]
Jul 29 00:09:09.799353 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.799285    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6995f5b4fd-9gpzr"]
Jul 29 00:09:09.821781 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.821751    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-oauth-serving-cert\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.821939 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.821810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-oauth-config\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.821939 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.821832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-service-ca\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.821939 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.821855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/81a99250-a61c-4578-8fc7-08049a2d60db-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9gh8j\" (UID: \"81a99250-a61c-4578-8fc7-08049a2d60db\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"
Jul 29 00:09:09.821939 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.821925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-tmp\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.822119 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.821969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-console-config\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.822119 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.822002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdz48\" (UniqueName: \"kubernetes.io/projected/aced471d-69ee-4640-8d39-5429abdf176b-kube-api-access-gdz48\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.822119 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.822034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnx5q\" (UniqueName: \"kubernetes.io/projected/9e21ffe0-f1f0-48bc-a94b-936a7a791c31-kube-api-access-bnx5q\") pod \"downloads-7c97dc4555-scw7m\" (UID: \"9e21ffe0-f1f0-48bc-a94b-936a7a791c31\") " pod="openshift-console/downloads-7c97dc4555-scw7m"
Jul 29 00:09:09.822119 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.822075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnttv\" (UniqueName: \"kubernetes.io/projected/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-kube-api-access-jnttv\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.822272 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.822153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-serving-cert\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.822272 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.822222    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-klusterlet-config\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.822272 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.822262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-tmp\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.823609 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.823584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:09.825052 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.825025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-klusterlet-config\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.833498 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.833473    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnttv\" (UniqueName: \"kubernetes.io/projected/dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff-kube-api-access-jnttv\") pod \"klusterlet-addon-workmgr-f9458f799-kjmpb\" (UID: \"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:09.921516 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.921482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:09.923412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.923392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-console-config\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.923513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.923423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdz48\" (UniqueName: \"kubernetes.io/projected/aced471d-69ee-4640-8d39-5429abdf176b-kube-api-access-gdz48\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.923513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.923452    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnx5q\" (UniqueName: \"kubernetes.io/projected/9e21ffe0-f1f0-48bc-a94b-936a7a791c31-kube-api-access-bnx5q\") pod \"downloads-7c97dc4555-scw7m\" (UID: \"9e21ffe0-f1f0-48bc-a94b-936a7a791c31\") " pod="openshift-console/downloads-7c97dc4555-scw7m"
Jul 29 00:09:09.923513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.923481    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-serving-cert\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.923620 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.923527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-oauth-serving-cert\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.923620 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.923597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-oauth-config\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.923725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.923627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-service-ca\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.923725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.923692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/81a99250-a61c-4578-8fc7-08049a2d60db-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9gh8j\" (UID: \"81a99250-a61c-4578-8fc7-08049a2d60db\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"
Jul 29 00:09:09.924281 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.924252    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-console-config\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.924373 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.924262    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-oauth-serving-cert\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.924438 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.924397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-service-ca\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.926139 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.926119    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/81a99250-a61c-4578-8fc7-08049a2d60db-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-9gh8j\" (UID: \"81a99250-a61c-4578-8fc7-08049a2d60db\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"
Jul 29 00:09:09.926227 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.926207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-oauth-config\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.926265 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.926255    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-serving-cert\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.937825 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.937651    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnx5q\" (UniqueName: \"kubernetes.io/projected/9e21ffe0-f1f0-48bc-a94b-936a7a791c31-kube-api-access-bnx5q\") pod \"downloads-7c97dc4555-scw7m\" (UID: \"9e21ffe0-f1f0-48bc-a94b-936a7a791c31\") " pod="openshift-console/downloads-7c97dc4555-scw7m"
Jul 29 00:09:09.937931 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.937836    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdz48\" (UniqueName: \"kubernetes.io/projected/aced471d-69ee-4640-8d39-5429abdf176b-kube-api-access-gdz48\") pod \"console-6995f5b4fd-9gpzr\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") " pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:09.947593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:09.947577    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:10.017772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.017739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:10.044419 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.044391    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"
Jul 29 00:09:10.063778 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.063722    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:10.067843 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.067819    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-scw7m"
Jul 29 00:09:10.080385 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.080348    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"]
Jul 29 00:09:10.082278 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:10.082240    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc1c0aa_9c49_41e7_b3a7_71bda406d5ff.slice/crio-70d41f25a95f157ec7c166c66be294fc968c5efd7cf8b7b890df5ba06a02fcf8 WatchSource:0}: Error finding container 70d41f25a95f157ec7c166c66be294fc968c5efd7cf8b7b890df5ba06a02fcf8: Status 404 returned error can't find the container with id 70d41f25a95f157ec7c166c66be294fc968c5efd7cf8b7b890df5ba06a02fcf8
Jul 29 00:09:10.133057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.132844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:10.198183 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.198153    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"]
Jul 29 00:09:10.201551 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:10.201529    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a99250_a61c_4578_8fc7_08049a2d60db.slice/crio-a317159166a64695ba0a12e83b1cf8c4561f936e187eb1a5898c014dfa3c12ee WatchSource:0}: Error finding container a317159166a64695ba0a12e83b1cf8c4561f936e187eb1a5898c014dfa3c12ee: Status 404 returned error can't find the container with id a317159166a64695ba0a12e83b1cf8c4561f936e187eb1a5898c014dfa3c12ee
Jul 29 00:09:10.208244 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.208224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:10.391102 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.391075    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rjl6p"
Jul 29 00:09:10.427896 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.427866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb" event={"ID":"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff","Type":"ContainerStarted","Data":"70d41f25a95f157ec7c166c66be294fc968c5efd7cf8b7b890df5ba06a02fcf8"}
Jul 29 00:09:10.429237 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.429207    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j" event={"ID":"81a99250-a61c-4578-8fc7-08049a2d60db","Type":"ContainerStarted","Data":"a317159166a64695ba0a12e83b1cf8c4561f936e187eb1a5898c014dfa3c12ee"}
Jul 29 00:09:10.432537 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.432505    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-scw7m"]
Jul 29 00:09:10.436352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:10.436293    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6995f5b4fd-9gpzr"]
Jul 29 00:09:10.441946 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:10.441918    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaced471d_69ee_4640_8d39_5429abdf176b.slice/crio-d57773e5f8dee51f7d84e9f5f7df5e638f33e42fb918ef072a33a665d6407fbb WatchSource:0}: Error finding container d57773e5f8dee51f7d84e9f5f7df5e638f33e42fb918ef072a33a665d6407fbb: Status 404 returned error can't find the container with id d57773e5f8dee51f7d84e9f5f7df5e638f33e42fb918ef072a33a665d6407fbb
Jul 29 00:09:11.436807 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:11.436708    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6995f5b4fd-9gpzr" event={"ID":"aced471d-69ee-4640-8d39-5429abdf176b","Type":"ContainerStarted","Data":"d57773e5f8dee51f7d84e9f5f7df5e638f33e42fb918ef072a33a665d6407fbb"}
Jul 29 00:09:11.439796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:11.439745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-scw7m" event={"ID":"9e21ffe0-f1f0-48bc-a94b-936a7a791c31","Type":"ContainerStarted","Data":"cbc3b33bdb4d77bed27f66eb9958562fe05f230a44f8d30de1c81c4d947fd68a"}
Jul 29 00:09:12.446908 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:12.446869    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j" event={"ID":"81a99250-a61c-4578-8fc7-08049a2d60db","Type":"ContainerStarted","Data":"007f51a748bfd52f361589a75830fe9f205a43f45aec6df998c87fbdbb716959"}
Jul 29 00:09:12.448001 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:12.447980    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"
Jul 29 00:09:12.454281 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:12.454253    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j"
Jul 29 00:09:12.468698 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:12.468622    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-9gh8j" podStartSLOduration=1.851823027 podStartE2EDuration="3.468602069s" totalImagesPullingTime="1.616779042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:12.466372199 +0000 UTC m=+84.030825155" watchObservedRunningTime="2026-07-29 00:09:12.468602069 +0000 UTC m=+84.033055024"
Jul 29 00:09:13.422464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.422429    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:13.466073 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.465069    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"]
Jul 29 00:09:13.514137 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.514075    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"]
Jul 29 00:09:13.514296 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.514202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.519310 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.519288    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 00:09:13.519457 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.519363    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 29 00:09:13.519593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.519574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8fd5n\""
Jul 29 00:09:13.519695 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.519643    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 29 00:09:13.539343 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.539267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:13.664835 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.664756    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcccc37f-beaa-4e89-912d-20537978940b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.665012 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.664857    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcccc37f-beaa-4e89-912d-20537978940b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.665012 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.664912    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tckd\" (UniqueName: \"kubernetes.io/projected/dcccc37f-beaa-4e89-912d-20537978940b-kube-api-access-5tckd\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.665012 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.664964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcccc37f-beaa-4e89-912d-20537978940b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.759502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.759419    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:13.766237 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.766197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tckd\" (UniqueName: \"kubernetes.io/projected/dcccc37f-beaa-4e89-912d-20537978940b-kube-api-access-5tckd\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.766387 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.766274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcccc37f-beaa-4e89-912d-20537978940b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.766387 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.766348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcccc37f-beaa-4e89-912d-20537978940b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.766508 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.766411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcccc37f-beaa-4e89-912d-20537978940b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.767195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.767170    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcccc37f-beaa-4e89-912d-20537978940b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.779653 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.779595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dcccc37f-beaa-4e89-912d-20537978940b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.780963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.780907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcccc37f-beaa-4e89-912d-20537978940b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.783897 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.783852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tckd\" (UniqueName: \"kubernetes.io/projected/dcccc37f-beaa-4e89-912d-20537978940b-kube-api-access-5tckd\") pod \"prometheus-operator-84d69f794d-jh6wq\" (UID: \"dcccc37f-beaa-4e89-912d-20537978940b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:13.828457 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:13.828415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"
Jul 29 00:09:14.777009 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:14.776911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:09:14.779804 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:14.779750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0b9f511-d540-4446-af02-fa758f2e10ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8wgqx\" (UID: \"a0b9f511-d540-4446-af02-fa758f2e10ac\") " pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:09:14.911150 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:14.911115    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gmgkv\""
Jul 29 00:09:14.916702 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:14.916598    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:14.918144 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:14.918120    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8wgqx"
Jul 29 00:09:14.970835 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:14.970793    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:15.868260 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:15.868208    2559 patch_prober.go:28] interesting pod/image-registry-5bfdf6f7fc-7sd6m container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 00:09:15.868718 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:15.868302    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m" podUID="da5cd444-9a48-4be6-add1-b0b337700071" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 00:09:16.173432 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:16.173340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:16.225616 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:16.225579    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:17.172623 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.172590    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8wgqx"]
Jul 29 00:09:17.176759 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:17.176733    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b9f511_d540_4446_af02_fa758f2e10ac.slice/crio-479b6aacb93d5a9d85eda1b1c83cb16389569d2d0fa98f3c6c4d7be36ce9320c WatchSource:0}: Error finding container 479b6aacb93d5a9d85eda1b1c83cb16389569d2d0fa98f3c6c4d7be36ce9320c: Status 404 returned error can't find the container with id 479b6aacb93d5a9d85eda1b1c83cb16389569d2d0fa98f3c6c4d7be36ce9320c
Jul 29 00:09:17.190151 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.190079    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-jh6wq"]
Jul 29 00:09:17.193174 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:17.193150    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcccc37f_beaa_4e89_912d_20537978940b.slice/crio-3e03e6f7133da42c58d05b1f3e39094e76f88202cae40abfe348557b250111b0 WatchSource:0}: Error finding container 3e03e6f7133da42c58d05b1f3e39094e76f88202cae40abfe348557b250111b0: Status 404 returned error can't find the container with id 3e03e6f7133da42c58d05b1f3e39094e76f88202cae40abfe348557b250111b0
Jul 29 00:09:17.473019 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.472951    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq" event={"ID":"dcccc37f-beaa-4e89-912d-20537978940b","Type":"ContainerStarted","Data":"3e03e6f7133da42c58d05b1f3e39094e76f88202cae40abfe348557b250111b0"}
Jul 29 00:09:17.474408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.474370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wgqx" event={"ID":"a0b9f511-d540-4446-af02-fa758f2e10ac","Type":"ContainerStarted","Data":"479b6aacb93d5a9d85eda1b1c83cb16389569d2d0fa98f3c6c4d7be36ce9320c"}
Jul 29 00:09:17.475954 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.475925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb" event={"ID":"dfc1c0aa-9c49-41e7-b3a7-71bda406d5ff","Type":"ContainerStarted","Data":"66f9f4aacae8808c0f6c8a9eb2550ec29f71c98c561bf807afb3553d2a8d0d34"}
Jul 29 00:09:17.476313 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.476287    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:17.477765 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.477742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6995f5b4fd-9gpzr" event={"ID":"aced471d-69ee-4640-8d39-5429abdf176b","Type":"ContainerStarted","Data":"ef4fab56e18196c77fb5ce3dfb5387a0beb1711749d28abdfed3af64043f0b0d"}
Jul 29 00:09:17.478355 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.478338    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb"
Jul 29 00:09:17.501253 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.501199    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f9458f799-kjmpb" podStartSLOduration=1.561288204 podStartE2EDuration="8.501172575s" totalImagesPullingTime="6.939884371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:17.499937739 +0000 UTC m=+89.064390690" watchObservedRunningTime="2026-07-29 00:09:17.501172575 +0000 UTC m=+89.065625528"
Jul 29 00:09:17.536947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.536884    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6995f5b4fd-9gpzr" podStartSLOduration=1.968825045 podStartE2EDuration="8.536862062s" totalImagesPullingTime="6.568037017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:17.536328961 +0000 UTC m=+89.100781914" watchObservedRunningTime="2026-07-29 00:09:17.536862062 +0000 UTC m=+89.101315018"
Jul 29 00:09:17.569977 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.569717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:17.672272 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:17.672238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:18.236284 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:18.236137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:18.337049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:18.337002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:18.381487 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:18.381460    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:09:18.603183 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:18.603081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:18.704339 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:18.704299    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:19.145109 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:19.145071    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:19.491292 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:19.491206    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq" event={"ID":"dcccc37f-beaa-4e89-912d-20537978940b","Type":"ContainerStarted","Data":"1fce30a9b11b4ce351959b260fcee02ece32d96871c71cc7197a266df2dbeef6"}
Jul 29 00:09:19.491292 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:19.491273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq" event={"ID":"dcccc37f-beaa-4e89-912d-20537978940b","Type":"ContainerStarted","Data":"e67f245a386bfbd38f793af6c0aef87b4005878cd0e10cd81c33aee21683d03e"}
Jul 29 00:09:19.510373 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:19.510326    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-jh6wq" podStartSLOduration=4.863340578 podStartE2EDuration="6.510308582s" totalImagesPullingTime="1.646968004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:19.508700424 +0000 UTC m=+91.073153379" watchObservedRunningTime="2026-07-29 00:09:19.510308582 +0000 UTC m=+91.074761535"
Jul 29 00:09:19.636520 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:19.636475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:19.740452 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:19.740378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:20.064354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:20.064320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:20.064538 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:20.064412    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:20.071828 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:20.071577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:20.502149 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:20.502120    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:21.367697 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.367630    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6995f5b4fd-9gpzr"]
Jul 29 00:09:21.561032 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.560965    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:21.786862 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.786639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:21.852836 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.852802    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-56j2d"]
Jul 29 00:09:21.874861 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.874820    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:21.882965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.882943    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:21.886913 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.886735    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 00:09:21.886913 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.886744    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4xnhn\""
Jul 29 00:09:21.887254 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.887233    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 00:09:21.887361 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:21.887300    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 00:09:22.000323 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.000246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gflw2\" (UniqueName: \"kubernetes.io/projected/f8f7c304-f8e2-44c1-a152-42d816f5b632-kube-api-access-gflw2\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046606    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-wtmp\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046635    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-sys\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-accelerators-collector-config\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-root\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046774    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-textfile\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-tls\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.047021 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.046839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f7c304-f8e2-44c1-a152-42d816f5b632-metrics-client-ca\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.101054 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.100972    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:22.147364 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f7c304-f8e2-44c1-a152-42d816f5b632-metrics-client-ca\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147541 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147541 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147442    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gflw2\" (UniqueName: \"kubernetes.io/projected/f8f7c304-f8e2-44c1-a152-42d816f5b632-kube-api-access-gflw2\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147541 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-wtmp\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147541 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147517    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-sys\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147790 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-accelerators-collector-config\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147790 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-root\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147790 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-textfile\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147790 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-tls\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.147991 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.147866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-wtmp\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.148478 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.148436    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-sys\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.148590 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.148501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f8f7c304-f8e2-44c1-a152-42d816f5b632-root\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.148736 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.148714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-accelerators-collector-config\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.148809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.148755    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-textfile\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.148922 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.148895    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8f7c304-f8e2-44c1-a152-42d816f5b632-metrics-client-ca\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.151094 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.151060    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-tls\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.158390 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.158191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gflw2\" (UniqueName: \"kubernetes.io/projected/f8f7c304-f8e2-44c1-a152-42d816f5b632-kube-api-access-gflw2\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.166639 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.166608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8f7c304-f8e2-44c1-a152-42d816f5b632-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-56j2d\" (UID: \"f8f7c304-f8e2-44c1-a152-42d816f5b632\") " pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.195292 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.195249    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-56j2d"
Jul 29 00:09:22.205580 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.205549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:22.272336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.272281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:22.706052 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.705955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:22.806006 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.805974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:22.915763 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:22.915655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:23.112908 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:23.112826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:24.494525 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:24.494487    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:24.595183 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:24.595142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:24.696172 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:24.696137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:24.788488 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:24.788409    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:24.845329 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:24.845287    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:24.988793 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:24.988749    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:25.297055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:25.297013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:25.366020 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:25.365910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:25.804100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:25.804070    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:26.365392 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:26.365363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-j8rqp"
Jul 29 00:09:26.599785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:26.599742    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:26.694831 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:26.694796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:27.073401 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:27.073324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:27.720480 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:27.720442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:27.826300 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:27.826267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:28.043172 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.043039    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:28.049120 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.049086    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-96b66fc7f-95znv"]
Jul 29 00:09:28.127595 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.127548    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96b66fc7f-95znv"]
Jul 29 00:09:28.128298 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.127682    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.137355 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.137310    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 00:09:28.203763 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.203717    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-serving-cert\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.204034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.203784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-trusted-ca-bundle\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.204034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.203823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-oauth-serving-cert\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.204034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.203858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-service-ca\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.204034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.203883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd44n\" (UniqueName: \"kubernetes.io/projected/357fccea-1431-475d-8a63-c36271a9e3e9-kube-api-access-qd44n\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.204034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.203929    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-oauth-config\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.204034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.203992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-console-config\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.305148 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.305049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-console-config\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.305148 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.305132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-serving-cert\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.305385 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.305173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-trusted-ca-bundle\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.305385 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.305196    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-oauth-serving-cert\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.305385 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.305220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-service-ca\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.305385 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.305240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd44n\" (UniqueName: \"kubernetes.io/projected/357fccea-1431-475d-8a63-c36271a9e3e9-kube-api-access-qd44n\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.305385 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.305269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-oauth-config\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.306513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.306080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-service-ca\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.306513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.306201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-trusted-ca-bundle\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.306513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.306389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-console-config\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.306857 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.306818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-oauth-serving-cert\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.308503 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.308480    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-serving-cert\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.309612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.309585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-oauth-config\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.316959 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.316931    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd44n\" (UniqueName: \"kubernetes.io/projected/357fccea-1431-475d-8a63-c36271a9e3e9-kube-api-access-qd44n\") pod \"console-96b66fc7f-95znv\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") " pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:28.439236 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:28.439203    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:30.705890 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:30.705745    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f7c304_f8e2_44c1_a152_42d816f5b632.slice/crio-97aa1e2af7763ec2494a89312fa7819d883669dcedf537ea9a580cc94eb33d8d WatchSource:0}: Error finding container 97aa1e2af7763ec2494a89312fa7819d883669dcedf537ea9a580cc94eb33d8d: Status 404 returned error can't find the container with id 97aa1e2af7763ec2494a89312fa7819d883669dcedf537ea9a580cc94eb33d8d
Jul 29 00:09:30.833620 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:30.833592    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96b66fc7f-95znv"]
Jul 29 00:09:30.837686 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:30.837569    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357fccea_1431_475d_8a63_c36271a9e3e9.slice/crio-222fce2aa78de226a881a51011387c9e1a5e7ca468eb0909e3270e55d5c4307a WatchSource:0}: Error finding container 222fce2aa78de226a881a51011387c9e1a5e7ca468eb0909e3270e55d5c4307a: Status 404 returned error can't find the container with id 222fce2aa78de226a881a51011387c9e1a5e7ca468eb0909e3270e55d5c4307a
Jul 29 00:09:31.557348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:31.557302    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-scw7m" event={"ID":"9e21ffe0-f1f0-48bc-a94b-936a7a791c31","Type":"ContainerStarted","Data":"aae95f5e2989959ff4fe25ace78df62b82ee15371c19e43012c1ea3938fd5211"}
Jul 29 00:09:31.557788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:31.557765    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-scw7m"
Jul 29 00:09:31.561149 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:31.561119    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wgqx" event={"ID":"a0b9f511-d540-4446-af02-fa758f2e10ac","Type":"ContainerStarted","Data":"c0fb3b84820c8ba6d19e72d1ca8af7c0f62a5a1d03a4722637ae6e27e3bc0553"}
Jul 29 00:09:31.563089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:31.563061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96b66fc7f-95znv" event={"ID":"357fccea-1431-475d-8a63-c36271a9e3e9","Type":"ContainerStarted","Data":"bd9290e7e62a2eb125915d7269eef313dbd718ff12ae6792c43e8b6f26b9dd28"}
Jul 29 00:09:31.563212 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:31.563109    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96b66fc7f-95znv" event={"ID":"357fccea-1431-475d-8a63-c36271a9e3e9","Type":"ContainerStarted","Data":"222fce2aa78de226a881a51011387c9e1a5e7ca468eb0909e3270e55d5c4307a"}
Jul 29 00:09:31.565318 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:31.565274    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-56j2d" event={"ID":"f8f7c304-f8e2-44c1-a152-42d816f5b632","Type":"ContainerStarted","Data":"97aa1e2af7763ec2494a89312fa7819d883669dcedf537ea9a580cc94eb33d8d"}
Jul 29 00:09:31.572007 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:31.571985    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-scw7m"
Jul 29 00:09:31.575906 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:31.575860    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-scw7m" podStartSLOduration=2.262432213 podStartE2EDuration="22.575843499s" totalImagesPullingTime="20.313411286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:31.574327372 +0000 UTC m=+103.138780331" watchObservedRunningTime="2026-07-29 00:09:31.575843499 +0000 UTC m=+103.140296451"
Jul 29 00:09:32.310245 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:32.310180    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-96b66fc7f-95znv" podStartSLOduration=4.310142645 podStartE2EDuration="4.310142645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:31.61607812 +0000 UTC m=+103.180531076" watchObservedRunningTime="2026-07-29 00:09:32.310142645 +0000 UTC m=+103.874595598"
Jul 29 00:09:32.311888 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:32.311860    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"]
Jul 29 00:09:32.400297 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:32.400134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:32.490786 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:32.490644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:32.589806 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:32.589730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:32.691501 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:32.690786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:33.436868 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:33.436832    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:33.493938 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:33.493899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:33.578461 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:33.578430    2559 generic.go:356] "Generic (PLEG): container finished" podID="f8f7c304-f8e2-44c1-a152-42d816f5b632" containerID="4e9b295fe865b82c3c4564c3f3d46631f595d2d1b0d4a8c3e3dcdecccf5d6884" exitCode=0
Jul 29 00:09:33.579544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:33.579515    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-56j2d" event={"ID":"f8f7c304-f8e2-44c1-a152-42d816f5b632","Type":"ContainerDied","Data":"4e9b295fe865b82c3c4564c3f3d46631f595d2d1b0d4a8c3e3dcdecccf5d6884"}
Jul 29 00:09:33.641272 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:33.641154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:33.699070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:33.698949    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:34.669292 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:34.669262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:34.770770 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:34.770585    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:34.870270 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:34.870236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:34.966504 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:34.966267    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:35.523111 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.523076    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96b66fc7f-95znv"]
Jul 29 00:09:35.572043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.572009    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6697799d87-krstl"]
Jul 29 00:09:35.594744 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.594662    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6697799d87-krstl"]
Jul 29 00:09:35.594915 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.594785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.678717 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.678651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-serving-cert\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.679333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.678836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-console-config\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.679333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.678961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-service-ca\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.679333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.679038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-oauth-config\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.679333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.679088    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhg29\" (UniqueName: \"kubernetes.io/projected/4ab1056a-4263-4598-9de8-16f11812ed75-kube-api-access-vhg29\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.679333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.679117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-trusted-ca-bundle\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.679333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.679201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-oauth-serving-cert\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.780172 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.780094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-oauth-config\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.780336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.780176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhg29\" (UniqueName: \"kubernetes.io/projected/4ab1056a-4263-4598-9de8-16f11812ed75-kube-api-access-vhg29\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.780336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.780212    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-trusted-ca-bundle\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.780336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.780259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-oauth-serving-cert\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.780336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.780297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-serving-cert\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.780540 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.780336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-console-config\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.780540 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.780382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-service-ca\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.781359 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.781333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-console-config\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.781495 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.781378    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-trusted-ca-bundle\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.782459 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.782338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-service-ca\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.783042 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.782984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-oauth-serving-cert\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.784000 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.783956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-oauth-config\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.787497 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.787474    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-serving-cert\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.791117 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.791093    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhg29\" (UniqueName: \"kubernetes.io/projected/4ab1056a-4263-4598-9de8-16f11812ed75-kube-api-access-vhg29\") pod \"console-6697799d87-krstl\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") " pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:35.910382 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:35.910195    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:36.644910 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:36.644613    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6697799d87-krstl"]
Jul 29 00:09:36.647929 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:36.647896    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab1056a_4263_4598_9de8_16f11812ed75.slice/crio-42dd6a9db96b862e5fefd3a75383ff0c1d8717baf32570795c09840cf8b5eca6 WatchSource:0}: Error finding container 42dd6a9db96b862e5fefd3a75383ff0c1d8717baf32570795c09840cf8b5eca6: Status 404 returned error can't find the container with id 42dd6a9db96b862e5fefd3a75383ff0c1d8717baf32570795c09840cf8b5eca6
Jul 29 00:09:37.565594 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.565562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:37.615286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.615246    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wgqx" event={"ID":"a0b9f511-d540-4446-af02-fa758f2e10ac","Type":"ContainerStarted","Data":"95fcf0395a701a8a95be33a6092ed020484ec7693f9b5eb9d7cb84d20ae18624"}
Jul 29 00:09:37.618908 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.618874    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-56j2d" event={"ID":"f8f7c304-f8e2-44c1-a152-42d816f5b632","Type":"ContainerStarted","Data":"265a27d063818c39e110c5ca22cbe0a69d70f48bbdf8d3e1e773bb7e15b22337"}
Jul 29 00:09:37.619195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.618932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-56j2d" event={"ID":"f8f7c304-f8e2-44c1-a152-42d816f5b632","Type":"ContainerStarted","Data":"6982c520084cfb5988936768da693c4b1620238801c486cb76289502532982fc"}
Jul 29 00:09:37.622005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.621958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6697799d87-krstl" event={"ID":"4ab1056a-4263-4598-9de8-16f11812ed75","Type":"ContainerStarted","Data":"2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e"}
Jul 29 00:09:37.622178 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.622142    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6697799d87-krstl" event={"ID":"4ab1056a-4263-4598-9de8-16f11812ed75","Type":"ContainerStarted","Data":"42dd6a9db96b862e5fefd3a75383ff0c1d8717baf32570795c09840cf8b5eca6"}
Jul 29 00:09:37.642796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.642739    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-56j2d" podStartSLOduration=14.485975038 podStartE2EDuration="16.642719004s" totalImagesPullingTime="2.033250283s" totalInitContainerRuntime="123.493683ms" isStatefulPod=true podCreationTimestamp="2026-07-29 00:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:37.639737425 +0000 UTC m=+109.204190377" watchObservedRunningTime="2026-07-29 00:09:37.642719004 +0000 UTC m=+109.207171957"
Jul 29 00:09:37.656287 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.656233    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6697799d87-krstl" podStartSLOduration=2.656214757 podStartE2EDuration="2.656214757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:09:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:37.656094048 +0000 UTC m=+109.220547002" watchObservedRunningTime="2026-07-29 00:09:37.656214757 +0000 UTC m=+109.220667710"
Jul 29 00:09:37.762041 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:37.761960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:38.117461 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:38.117362    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:38.217029 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:38.216974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:38.439439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:38.439359    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:09:42.648967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:42.648925    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8wgqx" event={"ID":"a0b9f511-d540-4446-af02-fa758f2e10ac","Type":"ContainerStarted","Data":"7dad8d407f3deda30e5350deff869fbf53cdcea936f1005a80f1897d64fdae37"}
Jul 29 00:09:42.686304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:42.686246    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8wgqx" podStartSLOduration=36.358727583 podStartE2EDuration="1m0.686227858s" totalImagesPullingTime="24.327500275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 00:08:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:09:42.685876979 +0000 UTC m=+114.250329932" watchObservedRunningTime="2026-07-29 00:09:42.686227858 +0000 UTC m=+114.250680837"
Jul 29 00:09:45.911259 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:45.911224    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:45.911853 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:45.911290    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:45.915850 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:45.915825    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:46.668275 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:46.668238    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:09:46.817746 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:46.817718    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:46.869080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:46.869051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:46.923123 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:46.923064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:47.536810 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.536750    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6995f5b4fd-9gpzr" podUID="aced471d-69ee-4640-8d39-5429abdf176b" containerName="console" containerID="cri-o://ef4fab56e18196c77fb5ce3dfb5387a0beb1711749d28abdfed3af64043f0b0d" gracePeriod=15
Jul 29 00:09:47.670286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.670261    2559 generic.go:356] "Generic (PLEG): container finished" podID="aced471d-69ee-4640-8d39-5429abdf176b" containerID="ef4fab56e18196c77fb5ce3dfb5387a0beb1711749d28abdfed3af64043f0b0d" exitCode=0
Jul 29 00:09:47.670393 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.670331    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6995f5b4fd-9gpzr" event={"ID":"aced471d-69ee-4640-8d39-5429abdf176b","Type":"ContainerDied","Data":"ef4fab56e18196c77fb5ce3dfb5387a0beb1711749d28abdfed3af64043f0b0d"}
Jul 29 00:09:47.812923 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.812865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:47.909002 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.908973    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-serving-cert\") pod \"aced471d-69ee-4640-8d39-5429abdf176b\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") "
Jul 29 00:09:47.909154 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.909011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-oauth-serving-cert\") pod \"aced471d-69ee-4640-8d39-5429abdf176b\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") "
Jul 29 00:09:47.909154 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.909065    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-console-config\") pod \"aced471d-69ee-4640-8d39-5429abdf176b\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") "
Jul 29 00:09:47.909154 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.909096    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdz48\" (UniqueName: \"kubernetes.io/projected/aced471d-69ee-4640-8d39-5429abdf176b-kube-api-access-gdz48\") pod \"aced471d-69ee-4640-8d39-5429abdf176b\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") "
Jul 29 00:09:47.909300 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.909172    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-service-ca\") pod \"aced471d-69ee-4640-8d39-5429abdf176b\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") "
Jul 29 00:09:47.909300 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.909198    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-oauth-config\") pod \"aced471d-69ee-4640-8d39-5429abdf176b\" (UID: \"aced471d-69ee-4640-8d39-5429abdf176b\") "
Jul 29 00:09:47.909524 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.909493    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aced471d-69ee-4640-8d39-5429abdf176b" (UID: "aced471d-69ee-4640-8d39-5429abdf176b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:09:47.909657 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.909491    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-console-config" (OuterVolumeSpecName: "console-config") pod "aced471d-69ee-4640-8d39-5429abdf176b" (UID: "aced471d-69ee-4640-8d39-5429abdf176b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:09:47.909657 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.909535    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-service-ca" (OuterVolumeSpecName: "service-ca") pod "aced471d-69ee-4640-8d39-5429abdf176b" (UID: "aced471d-69ee-4640-8d39-5429abdf176b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:09:47.911498 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.911475    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aced471d-69ee-4640-8d39-5429abdf176b" (UID: "aced471d-69ee-4640-8d39-5429abdf176b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:09:47.911589 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.911569    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aced471d-69ee-4640-8d39-5429abdf176b" (UID: "aced471d-69ee-4640-8d39-5429abdf176b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:09:47.911646 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:47.911585    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aced471d-69ee-4640-8d39-5429abdf176b-kube-api-access-gdz48" (OuterVolumeSpecName: "kube-api-access-gdz48") pod "aced471d-69ee-4640-8d39-5429abdf176b" (UID: "aced471d-69ee-4640-8d39-5429abdf176b"). InnerVolumeSpecName "kube-api-access-gdz48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:09:48.010192 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.010159    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-serving-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:48.010192 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.010183    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-oauth-serving-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:48.010192 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.010193    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-console-config\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:48.010192 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.010201    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdz48\" (UniqueName: \"kubernetes.io/projected/aced471d-69ee-4640-8d39-5429abdf176b-kube-api-access-gdz48\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:48.010621 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.010210    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aced471d-69ee-4640-8d39-5429abdf176b-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:48.010621 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.010218    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aced471d-69ee-4640-8d39-5429abdf176b-console-oauth-config\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:48.601530 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.601483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:48.675730 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.675697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6995f5b4fd-9gpzr" event={"ID":"aced471d-69ee-4640-8d39-5429abdf176b","Type":"ContainerDied","Data":"d57773e5f8dee51f7d84e9f5f7df5e638f33e42fb918ef072a33a665d6407fbb"}
Jul 29 00:09:48.675898 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.675784    2559 scope.go:117] "RemoveContainer" containerID="ef4fab56e18196c77fb5ce3dfb5387a0beb1711749d28abdfed3af64043f0b0d"
Jul 29 00:09:48.675898 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.675709    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6995f5b4fd-9gpzr"
Jul 29 00:09:48.695880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.695860    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6995f5b4fd-9gpzr"]
Jul 29 00:09:48.698411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.698382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:48.698779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:48.698762    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6995f5b4fd-9gpzr"]
Jul 29 00:09:49.010658 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:49.010627    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aced471d-69ee-4640-8d39-5429abdf176b" path="/var/lib/kubelet/pods/aced471d-69ee-4640-8d39-5429abdf176b/volumes"
Jul 29 00:09:56.305402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:56.305369    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:56.406284 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:56.406247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:56.466090 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:56.466051    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:09:57.343136 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.343088    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m" podUID="da5cd444-9a48-4be6-add1-b0b337700071" containerName="registry" containerID="cri-o://e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5" gracePeriod=30
Jul 29 00:09:57.620878 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.620850    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:09:57.715258 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.715226    2559 generic.go:356] "Generic (PLEG): container finished" podID="da5cd444-9a48-4be6-add1-b0b337700071" containerID="e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5" exitCode=0
Jul 29 00:09:57.715258 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.715261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m" event={"ID":"da5cd444-9a48-4be6-add1-b0b337700071","Type":"ContainerDied","Data":"e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5"}
Jul 29 00:09:57.715475 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.715269    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"
Jul 29 00:09:57.715475 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.715302    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m" event={"ID":"da5cd444-9a48-4be6-add1-b0b337700071","Type":"ContainerDied","Data":"a7322d51cbc44440da8b5a518fe2376932c19cfecee0b692f2a5a7dafa0aa3b5"}
Jul 29 00:09:57.715475 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.715322    2559 scope.go:117] "RemoveContainer" containerID="e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5"
Jul 29 00:09:57.724837 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.724814    2559 scope.go:117] "RemoveContainer" containerID="e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5"
Jul 29 00:09:57.725181 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:09:57.725131    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5\": container with ID starting with e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5 not found: ID does not exist" containerID="e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5"
Jul 29 00:09:57.725258 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.725194    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5"} err="failed to get container status \"e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5\": rpc error: code = NotFound desc = could not find container \"e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5\": container with ID starting with e7558e96556be8151a50c4debdb00ae4f625ff9cb6ac5c100b0987a39d5829c5 not found: ID does not exist"
Jul 29 00:09:57.794912 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.794876    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-registry-certificates\") pod \"da5cd444-9a48-4be6-add1-b0b337700071\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") "
Jul 29 00:09:57.795070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.794937    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-bound-sa-token\") pod \"da5cd444-9a48-4be6-add1-b0b337700071\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") "
Jul 29 00:09:57.795070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795007    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-image-registry-private-configuration\") pod \"da5cd444-9a48-4be6-add1-b0b337700071\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") "
Jul 29 00:09:57.795070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795054    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") pod \"da5cd444-9a48-4be6-add1-b0b337700071\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") "
Jul 29 00:09:57.795227 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795078    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-installation-pull-secrets\") pod \"da5cd444-9a48-4be6-add1-b0b337700071\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") "
Jul 29 00:09:57.795227 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795123    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da5cd444-9a48-4be6-add1-b0b337700071-ca-trust-extracted\") pod \"da5cd444-9a48-4be6-add1-b0b337700071\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") "
Jul 29 00:09:57.795227 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795153    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-trusted-ca\") pod \"da5cd444-9a48-4be6-add1-b0b337700071\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") "
Jul 29 00:09:57.795227 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795181    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nww9j\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-kube-api-access-nww9j\") pod \"da5cd444-9a48-4be6-add1-b0b337700071\" (UID: \"da5cd444-9a48-4be6-add1-b0b337700071\") "
Jul 29 00:09:57.795658 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795337    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "da5cd444-9a48-4be6-add1-b0b337700071" (UID: "da5cd444-9a48-4be6-add1-b0b337700071"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:09:57.795658 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795603    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-registry-certificates\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:57.795960 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.795904    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "da5cd444-9a48-4be6-add1-b0b337700071" (UID: "da5cd444-9a48-4be6-add1-b0b337700071"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:09:57.797782 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.797752    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "da5cd444-9a48-4be6-add1-b0b337700071" (UID: "da5cd444-9a48-4be6-add1-b0b337700071"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:09:57.797931 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.797904    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "da5cd444-9a48-4be6-add1-b0b337700071" (UID: "da5cd444-9a48-4be6-add1-b0b337700071"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:09:57.798047 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.797948    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "da5cd444-9a48-4be6-add1-b0b337700071" (UID: "da5cd444-9a48-4be6-add1-b0b337700071"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:09:57.798112 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.798073    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-kube-api-access-nww9j" (OuterVolumeSpecName: "kube-api-access-nww9j") pod "da5cd444-9a48-4be6-add1-b0b337700071" (UID: "da5cd444-9a48-4be6-add1-b0b337700071"). InnerVolumeSpecName "kube-api-access-nww9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:09:57.798155 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.798110    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "da5cd444-9a48-4be6-add1-b0b337700071" (UID: "da5cd444-9a48-4be6-add1-b0b337700071"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:09:57.803736 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.803644    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da5cd444-9a48-4be6-add1-b0b337700071-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "da5cd444-9a48-4be6-add1-b0b337700071" (UID: "da5cd444-9a48-4be6-add1-b0b337700071"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:09:57.897057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.896966    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-registry-tls\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:57.897057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.896999    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-installation-pull-secrets\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:57.897057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.897011    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/da5cd444-9a48-4be6-add1-b0b337700071-ca-trust-extracted\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:57.897057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.897019    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/da5cd444-9a48-4be6-add1-b0b337700071-trusted-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:57.897057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.897051    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nww9j\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-kube-api-access-nww9j\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:57.897057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.897064    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/da5cd444-9a48-4be6-add1-b0b337700071-bound-sa-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:57.897350 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:57.897078    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/da5cd444-9a48-4be6-add1-b0b337700071-image-registry-private-configuration\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:09:58.037594 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:58.037561    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"]
Jul 29 00:09:58.039288 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:58.039264    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bfdf6f7fc-7sd6m"]
Jul 29 00:09:58.704305 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:58.704277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:09:58.706761 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:58.706738    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3-metrics-certs\") pod \"network-metrics-daemon-sxmbj\" (UID: \"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3\") " pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:09:58.923262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:58.923227    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-thdv6\""
Jul 29 00:09:58.930967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:58.930944    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sxmbj"
Jul 29 00:09:59.010506 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:59.010477    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da5cd444-9a48-4be6-add1-b0b337700071" path="/var/lib/kubelet/pods/da5cd444-9a48-4be6-add1-b0b337700071/volumes"
Jul 29 00:09:59.092746 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:59.092723    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sxmbj"]
Jul 29 00:09:59.095187 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:09:59.095160    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5a2344_3ef0_4feb_8aa0_ba1b9a00c3e3.slice/crio-f0ea44f010a576e80bb8ab6a8e56a3310ded49fe035bfb52349fcb59d3363159 WatchSource:0}: Error finding container f0ea44f010a576e80bb8ab6a8e56a3310ded49fe035bfb52349fcb59d3363159: Status 404 returned error can't find the container with id f0ea44f010a576e80bb8ab6a8e56a3310ded49fe035bfb52349fcb59d3363159
Jul 29 00:09:59.726268 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:09:59.726232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sxmbj" event={"ID":"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3","Type":"ContainerStarted","Data":"f0ea44f010a576e80bb8ab6a8e56a3310ded49fe035bfb52349fcb59d3363159"}
Jul 29 00:10:00.545816 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.545771    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-96b66fc7f-95znv" podUID="357fccea-1431-475d-8a63-c36271a9e3e9" containerName="console" containerID="cri-o://bd9290e7e62a2eb125915d7269eef313dbd718ff12ae6792c43e8b6f26b9dd28" gracePeriod=15
Jul 29 00:10:00.731307 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.731278    2559 generic.go:356] "Generic (PLEG): container finished" podID="357fccea-1431-475d-8a63-c36271a9e3e9" containerID="bd9290e7e62a2eb125915d7269eef313dbd718ff12ae6792c43e8b6f26b9dd28" exitCode=0
Jul 29 00:10:00.731779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.731375    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96b66fc7f-95znv" event={"ID":"357fccea-1431-475d-8a63-c36271a9e3e9","Type":"ContainerDied","Data":"bd9290e7e62a2eb125915d7269eef313dbd718ff12ae6792c43e8b6f26b9dd28"}
Jul 29 00:10:00.735279 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.734868    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sxmbj" event={"ID":"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3","Type":"ContainerStarted","Data":"2632491a915bb0413da71693dfcd39880e42ee1dfda09425458cf2d24df9a0ac"}
Jul 29 00:10:00.855731 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.855706    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:10:00.926157 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926130    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-serving-cert\") pod \"357fccea-1431-475d-8a63-c36271a9e3e9\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") "
Jul 29 00:10:00.926336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926175    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-oauth-config\") pod \"357fccea-1431-475d-8a63-c36271a9e3e9\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") "
Jul 29 00:10:00.926336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926194    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-oauth-serving-cert\") pod \"357fccea-1431-475d-8a63-c36271a9e3e9\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") "
Jul 29 00:10:00.926336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926220    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-service-ca\") pod \"357fccea-1431-475d-8a63-c36271a9e3e9\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") "
Jul 29 00:10:00.926336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926244    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-console-config\") pod \"357fccea-1431-475d-8a63-c36271a9e3e9\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") "
Jul 29 00:10:00.926336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926272    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd44n\" (UniqueName: \"kubernetes.io/projected/357fccea-1431-475d-8a63-c36271a9e3e9-kube-api-access-qd44n\") pod \"357fccea-1431-475d-8a63-c36271a9e3e9\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") "
Jul 29 00:10:00.926576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-trusted-ca-bundle\") pod \"357fccea-1431-475d-8a63-c36271a9e3e9\" (UID: \"357fccea-1431-475d-8a63-c36271a9e3e9\") "
Jul 29 00:10:00.926762 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926725    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-console-config" (OuterVolumeSpecName: "console-config") pod "357fccea-1431-475d-8a63-c36271a9e3e9" (UID: "357fccea-1431-475d-8a63-c36271a9e3e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:10:00.926889 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926717    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "357fccea-1431-475d-8a63-c36271a9e3e9" (UID: "357fccea-1431-475d-8a63-c36271a9e3e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:10:00.926946 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926906    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "357fccea-1431-475d-8a63-c36271a9e3e9" (UID: "357fccea-1431-475d-8a63-c36271a9e3e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:10:00.926992 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.926850    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "357fccea-1431-475d-8a63-c36271a9e3e9" (UID: "357fccea-1431-475d-8a63-c36271a9e3e9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:10:00.928471 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.928445    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "357fccea-1431-475d-8a63-c36271a9e3e9" (UID: "357fccea-1431-475d-8a63-c36271a9e3e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:10:00.928561 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.928467    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "357fccea-1431-475d-8a63-c36271a9e3e9" (UID: "357fccea-1431-475d-8a63-c36271a9e3e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:10:00.928561 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:00.928517    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/357fccea-1431-475d-8a63-c36271a9e3e9-kube-api-access-qd44n" (OuterVolumeSpecName: "kube-api-access-qd44n") pod "357fccea-1431-475d-8a63-c36271a9e3e9" (UID: "357fccea-1431-475d-8a63-c36271a9e3e9"). InnerVolumeSpecName "kube-api-access-qd44n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:10:01.027484 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.027453    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-oauth-serving-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:10:01.027484 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.027482    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:10:01.027640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.027495    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-console-config\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:10:01.027640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.027506    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd44n\" (UniqueName: \"kubernetes.io/projected/357fccea-1431-475d-8a63-c36271a9e3e9-kube-api-access-qd44n\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:10:01.027640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.027518    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/357fccea-1431-475d-8a63-c36271a9e3e9-trusted-ca-bundle\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:10:01.027640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.027529    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-serving-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:10:01.027640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.027540    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/357fccea-1431-475d-8a63-c36271a9e3e9-console-oauth-config\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:10:01.742575 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.742549    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96b66fc7f-95znv"
Jul 29 00:10:01.743050 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.742547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96b66fc7f-95znv" event={"ID":"357fccea-1431-475d-8a63-c36271a9e3e9","Type":"ContainerDied","Data":"222fce2aa78de226a881a51011387c9e1a5e7ca468eb0909e3270e55d5c4307a"}
Jul 29 00:10:01.743050 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.742715    2559 scope.go:117] "RemoveContainer" containerID="bd9290e7e62a2eb125915d7269eef313dbd718ff12ae6792c43e8b6f26b9dd28"
Jul 29 00:10:01.744681 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.744625    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sxmbj" event={"ID":"6b5a2344-3ef0-4feb-8aa0-ba1b9a00c3e3","Type":"ContainerStarted","Data":"685cd0515d6d7f11b46487c06988781b0214d1496cfda7d9f04f0cecacb644ee"}
Jul 29 00:10:01.765384 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.765340    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sxmbj" podStartSLOduration=131.295973224 podStartE2EDuration="2m12.765325188s" totalImagesPullingTime="1.469351964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:10:01.76398809 +0000 UTC m=+133.328441041" watchObservedRunningTime="2026-07-29 00:10:01.765325188 +0000 UTC m=+133.329778160"
Jul 29 00:10:01.780156 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.780129    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96b66fc7f-95znv"]
Jul 29 00:10:01.782191 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.782170    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-96b66fc7f-95znv"]
Jul 29 00:10:01.893385 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.893355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:01.974784 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:01.974748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:02.750251 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:02.750217    2559 generic.go:356] "Generic (PLEG): container finished" podID="0db69871-87a8-4c88-8375-8d91aff8b186" containerID="2732038a14e296e8a3307799ceebcf2ac8bf7f82a656906d22f991b2785fd421" exitCode=0
Jul 29 00:10:02.750649 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:02.750291    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp" event={"ID":"0db69871-87a8-4c88-8375-8d91aff8b186","Type":"ContainerDied","Data":"2732038a14e296e8a3307799ceebcf2ac8bf7f82a656906d22f991b2785fd421"}
Jul 29 00:10:02.750743 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:02.750656    2559 scope.go:117] "RemoveContainer" containerID="2732038a14e296e8a3307799ceebcf2ac8bf7f82a656906d22f991b2785fd421"
Jul 29 00:10:03.010179 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:03.010092    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="357fccea-1431-475d-8a63-c36271a9e3e9" path="/var/lib/kubelet/pods/357fccea-1431-475d-8a63-c36271a9e3e9/volumes"
Jul 29 00:10:03.756647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:03.756604    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ghcvp" event={"ID":"0db69871-87a8-4c88-8375-8d91aff8b186","Type":"ContainerStarted","Data":"46bd5868eeac58801e3aebda5d470490644df0011ec39b2194fa2301edf8a650"}
Jul 29 00:10:09.434598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:09.434558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:12.794520 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:12.794488    2559 generic.go:356] "Generic (PLEG): container finished" podID="cb692481-489c-4ad6-8e06-26230cca2236" containerID="4784497f4a00d45fe469dc735bfda6a9d6518a1842c295f00a16e071d933683a" exitCode=0
Jul 29 00:10:12.795037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:12.794570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m" event={"ID":"cb692481-489c-4ad6-8e06-26230cca2236","Type":"ContainerDied","Data":"4784497f4a00d45fe469dc735bfda6a9d6518a1842c295f00a16e071d933683a"}
Jul 29 00:10:12.795037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:12.794978    2559 scope.go:117] "RemoveContainer" containerID="4784497f4a00d45fe469dc735bfda6a9d6518a1842c295f00a16e071d933683a"
Jul 29 00:10:12.798916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:12.798894    2559 generic.go:356] "Generic (PLEG): container finished" podID="c5c41fee-02ba-4fa3-9969-ced6c7d1f860" containerID="4ffb205b45960bf9db068fd468edf1cfde927818d6ac1e9692e2b572393bf355" exitCode=0
Jul 29 00:10:12.799064 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:12.798938    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hqssm" event={"ID":"c5c41fee-02ba-4fa3-9969-ced6c7d1f860","Type":"ContainerDied","Data":"4ffb205b45960bf9db068fd468edf1cfde927818d6ac1e9692e2b572393bf355"}
Jul 29 00:10:12.799204 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:12.799189    2559 scope.go:117] "RemoveContainer" containerID="4ffb205b45960bf9db068fd468edf1cfde927818d6ac1e9692e2b572393bf355"
Jul 29 00:10:13.804986 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:13.804950    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hqssm" event={"ID":"c5c41fee-02ba-4fa3-9969-ced6c7d1f860","Type":"ContainerStarted","Data":"ffca15ded186c996f9038d44b3c2614740be544519baa42ea5e3829f362cc6cf"}
Jul 29 00:10:13.807053 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:13.807023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m" event={"ID":"cb692481-489c-4ad6-8e06-26230cca2236","Type":"ContainerStarted","Data":"03283995de9b94f505a6d13a6ee0fcf15bbaaf9fb78ad36a80491ab480ccf80a"}
Jul 29 00:10:37.901938 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:37.901871    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:37.955606 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:37.955563    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:49.883272 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:49.883237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:49.945206 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:49.945181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:58.722340 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722297    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c564784d7-sd8xg"]
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722605    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da5cd444-9a48-4be6-add1-b0b337700071" containerName="registry"
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722617    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="da5cd444-9a48-4be6-add1-b0b337700071" containerName="registry"
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722624    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aced471d-69ee-4640-8d39-5429abdf176b" containerName="console"
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722630    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aced471d-69ee-4640-8d39-5429abdf176b" containerName="console"
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722649    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="357fccea-1431-475d-8a63-c36271a9e3e9" containerName="console"
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722654    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="357fccea-1431-475d-8a63-c36271a9e3e9" containerName="console"
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722719    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="da5cd444-9a48-4be6-add1-b0b337700071" containerName="registry"
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722727    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="357fccea-1431-475d-8a63-c36271a9e3e9" containerName="console"
Jul 29 00:10:58.722846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.722735    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aced471d-69ee-4640-8d39-5429abdf176b" containerName="console"
Jul 29 00:10:58.725470 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.725446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.742374 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.742350    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c564784d7-sd8xg"]
Jul 29 00:10:58.819734 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.819696    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:58.875551 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.875522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:10:58.892549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.892526    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-oauth-serving-cert\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.892693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.892561    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-console-config\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.892693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.892583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-trusted-ca-bundle\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.892693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.892605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-oauth-config\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.892802 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.892770    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-serving-cert\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.892844 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.892811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-service-ca\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.892881 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.892855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9sv\" (UniqueName: \"kubernetes.io/projected/bb835170-4266-4265-9389-56fc46e4227e-kube-api-access-jz9sv\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.994289 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.994214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-serving-cert\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.994289 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.994248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-service-ca\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.994289 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.994266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9sv\" (UniqueName: \"kubernetes.io/projected/bb835170-4266-4265-9389-56fc46e4227e-kube-api-access-jz9sv\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.994612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.994293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-oauth-serving-cert\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.994612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.994321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-console-config\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.994612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.994341    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-trusted-ca-bundle\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.994612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.994368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-oauth-config\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.995126 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.995093    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-service-ca\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.995225 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.995150    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-console-config\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.995352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.995334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-trusted-ca-bundle\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.995435 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.995415    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-oauth-serving-cert\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.997014 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.996994    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-serving-cert\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:58.997118 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:58.997102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-oauth-config\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:59.002377 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:59.002356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9sv\" (UniqueName: \"kubernetes.io/projected/bb835170-4266-4265-9389-56fc46e4227e-kube-api-access-jz9sv\") pod \"console-5c564784d7-sd8xg\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") " pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:59.035032 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:59.035001    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:10:59.162195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:10:59.162171    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c564784d7-sd8xg"]
Jul 29 00:10:59.164180 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:10:59.164140    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb835170_4266_4265_9389_56fc46e4227e.slice/crio-ccf0d28b5e8b1869d070e9fdcddcd40f3d14d4070b87a82bd63f17523774c740 WatchSource:0}: Error finding container ccf0d28b5e8b1869d070e9fdcddcd40f3d14d4070b87a82bd63f17523774c740: Status 404 returned error can't find the container with id ccf0d28b5e8b1869d070e9fdcddcd40f3d14d4070b87a82bd63f17523774c740
Jul 29 00:11:00.003446 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:00.003401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c564784d7-sd8xg" event={"ID":"bb835170-4266-4265-9389-56fc46e4227e","Type":"ContainerStarted","Data":"81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043"}
Jul 29 00:11:00.003911 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:00.003454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c564784d7-sd8xg" event={"ID":"bb835170-4266-4265-9389-56fc46e4227e","Type":"ContainerStarted","Data":"ccf0d28b5e8b1869d070e9fdcddcd40f3d14d4070b87a82bd63f17523774c740"}
Jul 29 00:11:00.021241 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:00.021197    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c564784d7-sd8xg" podStartSLOduration=2.021182583 podStartE2EDuration="2.021182583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:11:00.0199209 +0000 UTC m=+191.584373852" watchObservedRunningTime="2026-07-29 00:11:00.021182583 +0000 UTC m=+191.585635535"
Jul 29 00:11:03.649810 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:03.649771    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:03.746321 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:03.746282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:05.316333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:05.316298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:09.036755 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:09.035737    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:11:09.036755 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:09.035859    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:11:09.044480 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:09.044458    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:11:10.046166 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:10.046140    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:11:10.091125 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:10.091085    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6697799d87-krstl"]
Jul 29 00:11:10.195480 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:10.195447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:10.299774 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:10.299661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:10.353210 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:10.353183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:35.117298 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.117259    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6697799d87-krstl" podUID="4ab1056a-4263-4598-9de8-16f11812ed75" containerName="console" containerID="cri-o://2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e" gracePeriod=15
Jul 29 00:11:35.360632 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.360607    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:11:35.485647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.485578    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-oauth-config\") pod \"4ab1056a-4263-4598-9de8-16f11812ed75\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") "
Jul 29 00:11:35.485647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.485621    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-service-ca\") pod \"4ab1056a-4263-4598-9de8-16f11812ed75\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") "
Jul 29 00:11:35.485647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.485637    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-oauth-serving-cert\") pod \"4ab1056a-4263-4598-9de8-16f11812ed75\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") "
Jul 29 00:11:35.485937 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.485661    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-trusted-ca-bundle\") pod \"4ab1056a-4263-4598-9de8-16f11812ed75\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") "
Jul 29 00:11:35.485937 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.485698    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhg29\" (UniqueName: \"kubernetes.io/projected/4ab1056a-4263-4598-9de8-16f11812ed75-kube-api-access-vhg29\") pod \"4ab1056a-4263-4598-9de8-16f11812ed75\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") "
Jul 29 00:11:35.485937 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.485727    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-serving-cert\") pod \"4ab1056a-4263-4598-9de8-16f11812ed75\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") "
Jul 29 00:11:35.485937 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.485759    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-console-config\") pod \"4ab1056a-4263-4598-9de8-16f11812ed75\" (UID: \"4ab1056a-4263-4598-9de8-16f11812ed75\") "
Jul 29 00:11:35.486138 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.486066    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ab1056a-4263-4598-9de8-16f11812ed75" (UID: "4ab1056a-4263-4598-9de8-16f11812ed75"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:11:35.486138 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.486088    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ab1056a-4263-4598-9de8-16f11812ed75" (UID: "4ab1056a-4263-4598-9de8-16f11812ed75"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:11:35.486237 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.486095    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4ab1056a-4263-4598-9de8-16f11812ed75" (UID: "4ab1056a-4263-4598-9de8-16f11812ed75"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:11:35.486277 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.486261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-console-config" (OuterVolumeSpecName: "console-config") pod "4ab1056a-4263-4598-9de8-16f11812ed75" (UID: "4ab1056a-4263-4598-9de8-16f11812ed75"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:11:35.487937 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.487915    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab1056a-4263-4598-9de8-16f11812ed75-kube-api-access-vhg29" (OuterVolumeSpecName: "kube-api-access-vhg29") pod "4ab1056a-4263-4598-9de8-16f11812ed75" (UID: "4ab1056a-4263-4598-9de8-16f11812ed75"). InnerVolumeSpecName "kube-api-access-vhg29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:11:35.488402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.488383    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ab1056a-4263-4598-9de8-16f11812ed75" (UID: "4ab1056a-4263-4598-9de8-16f11812ed75"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:11:35.488474 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.488405    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ab1056a-4263-4598-9de8-16f11812ed75" (UID: "4ab1056a-4263-4598-9de8-16f11812ed75"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:11:35.591176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.587009    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-oauth-config\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:11:35.591176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.587040    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:11:35.591176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.587064    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-oauth-serving-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:11:35.591176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.587087    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-trusted-ca-bundle\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:11:35.591176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.587101    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhg29\" (UniqueName: \"kubernetes.io/projected/4ab1056a-4263-4598-9de8-16f11812ed75-kube-api-access-vhg29\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:11:35.591176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.587117    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ab1056a-4263-4598-9de8-16f11812ed75-console-serving-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:11:35.591176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:35.587134    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ab1056a-4263-4598-9de8-16f11812ed75-console-config\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:11:36.140523 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.140487    2559 generic.go:356] "Generic (PLEG): container finished" podID="4ab1056a-4263-4598-9de8-16f11812ed75" containerID="2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e" exitCode=0
Jul 29 00:11:36.140951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.140546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6697799d87-krstl" event={"ID":"4ab1056a-4263-4598-9de8-16f11812ed75","Type":"ContainerDied","Data":"2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e"}
Jul 29 00:11:36.140951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.140553    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6697799d87-krstl"
Jul 29 00:11:36.140951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.140596    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6697799d87-krstl" event={"ID":"4ab1056a-4263-4598-9de8-16f11812ed75","Type":"ContainerDied","Data":"42dd6a9db96b862e5fefd3a75383ff0c1d8717baf32570795c09840cf8b5eca6"}
Jul 29 00:11:36.140951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.140624    2559 scope.go:117] "RemoveContainer" containerID="2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e"
Jul 29 00:11:36.149599 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.149584    2559 scope.go:117] "RemoveContainer" containerID="2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e"
Jul 29 00:11:36.149867 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:11:36.149850    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e\": container with ID starting with 2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e not found: ID does not exist" containerID="2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e"
Jul 29 00:11:36.149914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.149876    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e"} err="failed to get container status \"2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e\": rpc error: code = NotFound desc = could not find container \"2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e\": container with ID starting with 2b82684716df047f027bb30833fa915d615f3aa205f4efbf41a4ed90f142943e not found: ID does not exist"
Jul 29 00:11:36.161628 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.161603    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6697799d87-krstl"]
Jul 29 00:11:36.168122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:36.168101    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6697799d87-krstl"]
Jul 29 00:11:37.009421 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:37.009394    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ab1056a-4263-4598-9de8-16f11812ed75" path="/var/lib/kubelet/pods/4ab1056a-4263-4598-9de8-16f11812ed75/volumes"
Jul 29 00:11:40.065184 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:40.065151    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:40.163011 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:40.162983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:43.783935 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:43.783888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:11:43.837840 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:11:43.837800    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:06.879757 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:06.879715    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:07.704057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:07.704019    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:10.729854 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:10.729769    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:10.829933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:10.829897    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:11.778225 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:11.778192    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:11.922083 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:11.922053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:12.220195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:12.220164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:12.312900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:12.312860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:13.987011 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:13.986974    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"]
Jul 29 00:12:13.987451 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:13.987355    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab1056a-4263-4598-9de8-16f11812ed75" containerName="console"
Jul 29 00:12:13.987451 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:13.987373    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab1056a-4263-4598-9de8-16f11812ed75" containerName="console"
Jul 29 00:12:13.987548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:13.987456    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ab1056a-4263-4598-9de8-16f11812ed75" containerName="console"
Jul 29 00:12:13.990410 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:13.990387    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"
Jul 29 00:12:13.993239 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:13.993220    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 00:12:13.993339 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:13.993256    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fs6st\""
Jul 29 00:12:13.994481 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:13.994465    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 00:12:14.000706 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.000661    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"]
Jul 29 00:12:14.028337 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.028311    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:14.088930 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.088908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfd04e07-cc25-41ed-a00e-83e08c7989fa-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hzrlx\" (UID: \"cfd04e07-cc25-41ed-a00e-83e08c7989fa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"
Jul 29 00:12:14.089060 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.088974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nndtf\" (UniqueName: \"kubernetes.io/projected/cfd04e07-cc25-41ed-a00e-83e08c7989fa-kube-api-access-nndtf\") pod \"cert-manager-cainjector-559cdd8c87-hzrlx\" (UID: \"cfd04e07-cc25-41ed-a00e-83e08c7989fa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"
Jul 29 00:12:14.190252 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.190227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nndtf\" (UniqueName: \"kubernetes.io/projected/cfd04e07-cc25-41ed-a00e-83e08c7989fa-kube-api-access-nndtf\") pod \"cert-manager-cainjector-559cdd8c87-hzrlx\" (UID: \"cfd04e07-cc25-41ed-a00e-83e08c7989fa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"
Jul 29 00:12:14.190371 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.190286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfd04e07-cc25-41ed-a00e-83e08c7989fa-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hzrlx\" (UID: \"cfd04e07-cc25-41ed-a00e-83e08c7989fa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"
Jul 29 00:12:14.200598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.200577    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfd04e07-cc25-41ed-a00e-83e08c7989fa-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hzrlx\" (UID: \"cfd04e07-cc25-41ed-a00e-83e08c7989fa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"
Jul 29 00:12:14.200842 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.200822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nndtf\" (UniqueName: \"kubernetes.io/projected/cfd04e07-cc25-41ed-a00e-83e08c7989fa-kube-api-access-nndtf\") pod \"cert-manager-cainjector-559cdd8c87-hzrlx\" (UID: \"cfd04e07-cc25-41ed-a00e-83e08c7989fa\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"
Jul 29 00:12:14.312815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.312712    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"
Jul 29 00:12:14.441087 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.441064    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx"]
Jul 29 00:12:14.443618 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:12:14.443591    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfd04e07_cc25_41ed_a00e_83e08c7989fa.slice/crio-0415076208e8e143b6f31604f9cfeb681edacebb987496a15015e6b70ede9741 WatchSource:0}: Error finding container 0415076208e8e143b6f31604f9cfeb681edacebb987496a15015e6b70ede9741: Status 404 returned error can't find the container with id 0415076208e8e143b6f31604f9cfeb681edacebb987496a15015e6b70ede9741
Jul 29 00:12:14.600084 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:14.600009    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:15.289054 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:15.289017    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx" event={"ID":"cfd04e07-cc25-41ed-a00e-83e08c7989fa","Type":"ContainerStarted","Data":"0415076208e8e143b6f31604f9cfeb681edacebb987496a15015e6b70ede9741"}
Jul 29 00:12:17.491901 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:17.491817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:17.554969 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:17.554928    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:19.306709 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:19.306644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx" event={"ID":"cfd04e07-cc25-41ed-a00e-83e08c7989fa","Type":"ContainerStarted","Data":"ab3a016d9349f10973a2108c055ed46c3c9410e524946e30c6cbc7b0010e7d8c"}
Jul 29 00:12:19.323550 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:19.323477    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hzrlx" podStartSLOduration=1.66367555 podStartE2EDuration="6.323462754s" totalImagesPullingTime="4.659787204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:12:19.322450472 +0000 UTC m=+270.886903425" watchObservedRunningTime="2026-07-29 00:12:19.323462754 +0000 UTC m=+270.887915705"
Jul 29 00:12:19.884089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:19.884052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:19.946447 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:19.946407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:23.405965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:23.405926    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:26.893087 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:26.893057    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:26.992985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:26.992931    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:33.736046 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:33.736013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:33.836882 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:33.836849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:35.848424 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:35.848384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:43.982359 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:43.982321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:47.506390 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:47.506349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:47.607516 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:47.607485    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:48.124890 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.124852    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:48.378223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.378137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:48.472035 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.471979    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:48.493916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.493887    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"]
Jul 29 00:12:48.497294 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.497274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.500981 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.500960    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 00:12:48.501985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.501952    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 00:12:48.501985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.501968    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 00:12:48.502243 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.502227    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 00:12:48.502338 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.502321    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gwq8d\""
Jul 29 00:12:48.511568 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.511543    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"]
Jul 29 00:12:48.559175 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.559142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f1819ab-2293-4b08-a81a-f766dfff8335-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.559335 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.559183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1819ab-2293-4b08-a81a-f766dfff8335-tmp\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.559335 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.559212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8s4l\" (UniqueName: \"kubernetes.io/projected/1f1819ab-2293-4b08-a81a-f766dfff8335-kube-api-access-b8s4l\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.559335 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.559255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f1819ab-2293-4b08-a81a-f766dfff8335-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.559335 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.559283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f1819ab-2293-4b08-a81a-f766dfff8335-manifests\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.623479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.623448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:48.660124 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.660057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1819ab-2293-4b08-a81a-f766dfff8335-tmp\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.660124 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.660096    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8s4l\" (UniqueName: \"kubernetes.io/projected/1f1819ab-2293-4b08-a81a-f766dfff8335-kube-api-access-b8s4l\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.660268 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.660131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f1819ab-2293-4b08-a81a-f766dfff8335-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.660268 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.660158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f1819ab-2293-4b08-a81a-f766dfff8335-manifests\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.660268 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.660179    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f1819ab-2293-4b08-a81a-f766dfff8335-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.660561 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.660525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f1819ab-2293-4b08-a81a-f766dfff8335-manifests\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.662704 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.662643    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f1819ab-2293-4b08-a81a-f766dfff8335-tmp\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.662839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.662770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f1819ab-2293-4b08-a81a-f766dfff8335-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.662937 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.662916    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f1819ab-2293-4b08-a81a-f766dfff8335-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.668263 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.668243    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8s4l\" (UniqueName: \"kubernetes.io/projected/1f1819ab-2293-4b08-a81a-f766dfff8335-kube-api-access-b8s4l\") pod \"opendatahub-operator-controller-manager-6fc48f86bc-rnj9f\" (UID: \"1f1819ab-2293-4b08-a81a-f766dfff8335\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.723852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.723817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:48.807842 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.807805    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:48.823876 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.823843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:48.853721 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.853694    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:12:48.858097 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.858076    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:12:48.863855 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.863829    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:12:48.868692 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.868500    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 00:12:48.870933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.870916    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:12:48.952029 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.951944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:48.964502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:48.964479    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"]
Jul 29 00:12:48.966944 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:12:48.966918    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1819ab_2293_4b08_a81a_f766dfff8335.slice/crio-25558e0210860049a294e8bb401e71dfb0c9dc81dad94fb5cfba569a58d5fc42 WatchSource:0}: Error finding container 25558e0210860049a294e8bb401e71dfb0c9dc81dad94fb5cfba569a58d5fc42: Status 404 returned error can't find the container with id 25558e0210860049a294e8bb401e71dfb0c9dc81dad94fb5cfba569a58d5fc42
Jul 29 00:12:49.099487 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:49.099332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:49.200252 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:49.200212    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:12:49.418983 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:49.418952    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f" event={"ID":"1f1819ab-2293-4b08-a81a-f766dfff8335","Type":"ContainerStarted","Data":"25558e0210860049a294e8bb401e71dfb0c9dc81dad94fb5cfba569a58d5fc42"}
Jul 29 00:12:52.434352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:52.434318    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f" event={"ID":"1f1819ab-2293-4b08-a81a-f766dfff8335","Type":"ContainerStarted","Data":"a9bc8e5f0ea86cd4b4f69e33da00e386c764178ca0b11ee4cf130c53a123e397"}
Jul 29 00:12:53.440369 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:53.440332    2559 generic.go:356] "Generic (PLEG): container finished" podID="1f1819ab-2293-4b08-a81a-f766dfff8335" containerID="a9bc8e5f0ea86cd4b4f69e33da00e386c764178ca0b11ee4cf130c53a123e397" exitCode=0
Jul 29 00:12:53.440767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:53.440420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f" event={"ID":"1f1819ab-2293-4b08-a81a-f766dfff8335","Type":"ContainerDied","Data":"a9bc8e5f0ea86cd4b4f69e33da00e386c764178ca0b11ee4cf130c53a123e397"}
Jul 29 00:12:53.440904 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:53.440890    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 00:12:54.446013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:54.445977    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f" event={"ID":"1f1819ab-2293-4b08-a81a-f766dfff8335","Type":"ContainerStarted","Data":"ff6f010c20efdadd9420fc97e324d1af8531fc89a3d2f208b75ead677070a873"}
Jul 29 00:12:54.446453 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:54.446120    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:12:54.469541 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:12:54.469499    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f" podStartSLOduration=1.811412685 podStartE2EDuration="6.469486868s" totalImagesPullingTime="3.653275603s" totalInitContainerRuntime="1.00479858s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:12:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:12:54.46816668 +0000 UTC m=+306.032619632" watchObservedRunningTime="2026-07-29 00:12:54.469486868 +0000 UTC m=+306.033939819"
Jul 29 00:13:00.580660 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:00.580628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:00.682864 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:00.682830    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:05.452480 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:05.452448    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc48f86bc-rnj9f"
Jul 29 00:13:07.690341 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:07.690304    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:07.810491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:07.810460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:08.392970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.392935    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dv99z"]
Jul 29 00:13:08.402930 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.402904    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:08.406497 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.406473    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 29 00:13:08.406614 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.406474    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-w7zws\""
Jul 29 00:13:08.429389 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.429361    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dv99z"]
Jul 29 00:13:08.493640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.493607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:08.522351 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.522316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzw9d\" (UniqueName: \"kubernetes.io/projected/ad953eca-4f1b-49f5-82a3-ce2ce97bced2-kube-api-access-nzw9d\") pod \"odh-model-controller-7998c67dc4-dv99z\" (UID: \"ad953eca-4f1b-49f5-82a3-ce2ce97bced2\") " pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:08.522351 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.522352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad953eca-4f1b-49f5-82a3-ce2ce97bced2-cert\") pod \"odh-model-controller-7998c67dc4-dv99z\" (UID: \"ad953eca-4f1b-49f5-82a3-ce2ce97bced2\") " pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:08.622885 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.622849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzw9d\" (UniqueName: \"kubernetes.io/projected/ad953eca-4f1b-49f5-82a3-ce2ce97bced2-kube-api-access-nzw9d\") pod \"odh-model-controller-7998c67dc4-dv99z\" (UID: \"ad953eca-4f1b-49f5-82a3-ce2ce97bced2\") " pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:08.622885 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.622885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad953eca-4f1b-49f5-82a3-ce2ce97bced2-cert\") pod \"odh-model-controller-7998c67dc4-dv99z\" (UID: \"ad953eca-4f1b-49f5-82a3-ce2ce97bced2\") " pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:08.625448 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.625423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad953eca-4f1b-49f5-82a3-ce2ce97bced2-cert\") pod \"odh-model-controller-7998c67dc4-dv99z\" (UID: \"ad953eca-4f1b-49f5-82a3-ce2ce97bced2\") " pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:08.632481 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.632453    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzw9d\" (UniqueName: \"kubernetes.io/projected/ad953eca-4f1b-49f5-82a3-ce2ce97bced2-kube-api-access-nzw9d\") pod \"odh-model-controller-7998c67dc4-dv99z\" (UID: \"ad953eca-4f1b-49f5-82a3-ce2ce97bced2\") " pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:08.712559 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.712467    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:08.848566 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:08.848541    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-dv99z"]
Jul 29 00:13:08.850696 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:13:08.850649    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad953eca_4f1b_49f5_82a3_ce2ce97bced2.slice/crio-053cad9b2b8d153cff5dbee5638ee10954dedf55d813b6dbc206d700ee521589 WatchSource:0}: Error finding container 053cad9b2b8d153cff5dbee5638ee10954dedf55d813b6dbc206d700ee521589: Status 404 returned error can't find the container with id 053cad9b2b8d153cff5dbee5638ee10954dedf55d813b6dbc206d700ee521589
Jul 29 00:13:09.508373 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:09.508339    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dv99z" event={"ID":"ad953eca-4f1b-49f5-82a3-ce2ce97bced2","Type":"ContainerStarted","Data":"053cad9b2b8d153cff5dbee5638ee10954dedf55d813b6dbc206d700ee521589"}
Jul 29 00:13:10.012728 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:10.012689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:12.530989 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:12.530953    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-dv99z" event={"ID":"ad953eca-4f1b-49f5-82a3-ce2ce97bced2","Type":"ContainerStarted","Data":"64c6c6e6546df9f894638c39288e5cfa7659a5fab5227bb8dd01339f00388e82"}
Jul 29 00:13:12.531417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:12.531086    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:12.558348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:12.558295    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-dv99z" podStartSLOduration=1.5501209519999999 podStartE2EDuration="4.558281056s" totalImagesPullingTime="3.008160104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:13:12.557021208 +0000 UTC m=+324.121474159" watchObservedRunningTime="2026-07-29 00:13:12.558281056 +0000 UTC m=+324.122734008"
Jul 29 00:13:13.943143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.943108    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"]
Jul 29 00:13:13.946393 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.946373    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:13.950491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.950469    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 00:13:13.950753 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.950488    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ntbtl\""
Jul 29 00:13:13.950753 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.950509    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 00:13:13.950753 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.950519    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 00:13:13.950753 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.950523    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 00:13:13.950753 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.950612    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 00:13:13.955020 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.954998    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"]
Jul 29 00:13:13.972348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.972320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/18f6d213-10ba-4846-842f-f3b5c6cabac1-metrics-cert\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:13.972477 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.972457    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/18f6d213-10ba-4846-842f-f3b5c6cabac1-manager-config\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:13.972544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.972508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18f6d213-10ba-4846-842f-f3b5c6cabac1-cert\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:13.972616 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:13.972598    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt8cw\" (UniqueName: \"kubernetes.io/projected/18f6d213-10ba-4846-842f-f3b5c6cabac1-kube-api-access-dt8cw\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.073128 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.073095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/18f6d213-10ba-4846-842f-f3b5c6cabac1-manager-config\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.073334 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.073138    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18f6d213-10ba-4846-842f-f3b5c6cabac1-cert\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.073334 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.073255    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt8cw\" (UniqueName: \"kubernetes.io/projected/18f6d213-10ba-4846-842f-f3b5c6cabac1-kube-api-access-dt8cw\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.073334 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.073302    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/18f6d213-10ba-4846-842f-f3b5c6cabac1-metrics-cert\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.073846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.073813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/18f6d213-10ba-4846-842f-f3b5c6cabac1-manager-config\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.075745 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.075724    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/18f6d213-10ba-4846-842f-f3b5c6cabac1-metrics-cert\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.076198 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.076178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18f6d213-10ba-4846-842f-f3b5c6cabac1-cert\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.081366 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.081341    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt8cw\" (UniqueName: \"kubernetes.io/projected/18f6d213-10ba-4846-842f-f3b5c6cabac1-kube-api-access-dt8cw\") pod \"lws-controller-manager-794d6b68f4-x2zwj\" (UID: \"18f6d213-10ba-4846-842f-f3b5c6cabac1\") " pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.256628 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.256542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:14.387226 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.387187    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"]
Jul 29 00:13:14.390409 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:13:14.390384    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f6d213_10ba_4846_842f_f3b5c6cabac1.slice/crio-6d967bb832ec56a73b0252db1b1a6f768b56ef323633db125602e4682dd6e45a WatchSource:0}: Error finding container 6d967bb832ec56a73b0252db1b1a6f768b56ef323633db125602e4682dd6e45a: Status 404 returned error can't find the container with id 6d967bb832ec56a73b0252db1b1a6f768b56ef323633db125602e4682dd6e45a
Jul 29 00:13:14.542121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:14.542043    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj" event={"ID":"18f6d213-10ba-4846-842f-f3b5c6cabac1","Type":"ContainerStarted","Data":"6d967bb832ec56a73b0252db1b1a6f768b56ef323633db125602e4682dd6e45a"}
Jul 29 00:13:17.557803 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:17.557765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj" event={"ID":"18f6d213-10ba-4846-842f-f3b5c6cabac1","Type":"ContainerStarted","Data":"6d554f5e6a94d438c0ed380505ef15913715a92a9b74ec45bba9564bcce5cfe9"}
Jul 29 00:13:17.558222 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:17.557843    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:17.587288 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:17.587233    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj" podStartSLOduration=2.393460193 podStartE2EDuration="4.587217421s" totalImagesPullingTime="2.193757228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:13:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:13:17.584978569 +0000 UTC m=+329.149431521" watchObservedRunningTime="2026-07-29 00:13:17.587217421 +0000 UTC m=+329.151670373"
Jul 29 00:13:17.859056 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:17.858956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:17.977900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:17.977866    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:18.221397 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:18.221365    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:18.488720 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:18.488609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:18.725980 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:18.725943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:18.974567 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:18.974535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:19.321594 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:19.321504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:19.421645 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:19.421618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:20.492955 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:20.492923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:20.589173 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:20.589135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:21.773891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:21.773850    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:23.538711 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:23.538653    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-dv99z"
Jul 29 00:13:28.565066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:28.565035    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-794d6b68f4-x2zwj"
Jul 29 00:13:43.883994 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:43.883915    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:43.978016 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:43.977980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:45.832803 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:45.832767    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:45.883974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:45.883943    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:56.832335 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:56.827622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:56.930934 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:56.930898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:57.075406 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.075377    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"]
Jul 29 00:13:57.080842 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.080822    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.083791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.083742    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 00:13:57.083791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.083778    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lv7cb\""
Jul 29 00:13:57.090005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.089983    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"]
Jul 29 00:13:57.109900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.109871    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:57.154464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.154438    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"]
Jul 29 00:13:57.156597 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.156581    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.168763 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.168739    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"]
Jul 29 00:13:57.243386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243350    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6lqx\" (UniqueName: \"kubernetes.io/projected/0577742a-d11f-4aba-b106-5e5fc1c7ac56-kube-api-access-c6lqx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.243598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.243598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243548    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.243598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243610    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba378fe6-6682-47e7-b43a-c16d5af74606-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243630    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243836    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.243879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.243850    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfpvq\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-kube-api-access-qfpvq\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.260209 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.260186    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:57.344613 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.344613 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.344829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.344829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.344829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344690    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.344829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344722    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.344829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.344829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba378fe6-6682-47e7-b43a-c16d5af74606-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.344829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.344829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344818    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344859    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344882    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344958    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.344990    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfpvq\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-kube-api-access-qfpvq\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6lqx\" (UniqueName: \"kubernetes.io/projected/0577742a-d11f-4aba-b106-5e5fc1c7ac56-kube-api-access-c6lqx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345070    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345087    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345106    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345122    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345861 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.345861 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345374    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.345861 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345861 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345539    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.345861 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345623    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.345861 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.345852    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.346381 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.346354    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba378fe6-6682-47e7-b43a-c16d5af74606-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.347443 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.347422    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.347530 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.347446    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.347856 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.347834    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.347928 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.347874    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.351417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.351393    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:13:57.354898 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.354879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0577742a-d11f-4aba-b106-5e5fc1c7ac56-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.354977 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.354925    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6lqx\" (UniqueName: \"kubernetes.io/projected/0577742a-d11f-4aba-b106-5e5fc1c7ac56-kube-api-access-c6lqx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf\" (UID: \"0577742a-d11f-4aba-b106-5e5fc1c7ac56\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.354977 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.354938    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.358394 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.358375    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfpvq\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-kube-api-access-qfpvq\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcdf52x\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.391403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.391378    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:13:57.466190 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.466157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:13:57.528704 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.528651    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"]
Jul 29 00:13:57.532936 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:13:57.532898    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba378fe6_6682_47e7_b43a_c16d5af74606.slice/crio-5e008e9652ba76268cf6de91dacae94cdc3d21543365e406469696add5918499 WatchSource:0}: Error finding container 5e008e9652ba76268cf6de91dacae94cdc3d21543365e406469696add5918499: Status 404 returned error can't find the container with id 5e008e9652ba76268cf6de91dacae94cdc3d21543365e406469696add5918499
Jul 29 00:13:57.605924 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.605834    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"]
Jul 29 00:13:57.608004 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:13:57.607979    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0577742a_d11f_4aba_b106_5e5fc1c7ac56.slice/crio-fa7094c19ede402f12eb48b585774b996ff06617f53109e07e601254d9fd9c55 WatchSource:0}: Error finding container fa7094c19ede402f12eb48b585774b996ff06617f53109e07e601254d9fd9c55: Status 404 returned error can't find the container with id fa7094c19ede402f12eb48b585774b996ff06617f53109e07e601254d9fd9c55
Jul 29 00:13:57.726352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.726314    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf" event={"ID":"0577742a-d11f-4aba-b106-5e5fc1c7ac56","Type":"ContainerStarted","Data":"fa7094c19ede402f12eb48b585774b996ff06617f53109e07e601254d9fd9c55"}
Jul 29 00:13:57.727461 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:13:57.727437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" event={"ID":"ba378fe6-6682-47e7-b43a-c16d5af74606","Type":"ContainerStarted","Data":"5e008e9652ba76268cf6de91dacae94cdc3d21543365e406469696add5918499"}
Jul 29 00:14:00.624648 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.624608    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:14:00.624986 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.624701    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:14:00.624986 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.624732    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:14:00.630854 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.630831    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:14:00.630931 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.630883    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:14:00.630931 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.630912    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:14:00.751704 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.750045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" event={"ID":"ba378fe6-6682-47e7-b43a-c16d5af74606","Type":"ContainerStarted","Data":"df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572"}
Jul 29 00:14:00.754956 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.754683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf" event={"ID":"0577742a-d11f-4aba-b106-5e5fc1c7ac56","Type":"ContainerStarted","Data":"09e00d3e75258f5b198fef380cda8aef47ecb21c2444b151dfaa97d2820f6a80"}
Jul 29 00:14:00.773774 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.773719    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" podStartSLOduration=0.678254695 podStartE2EDuration="3.773697945s" totalImagesPullingTime="3.09544325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:14:00.771475012 +0000 UTC m=+372.335927962" watchObservedRunningTime="2026-07-29 00:14:00.773697945 +0000 UTC m=+372.338150898"
Jul 29 00:14:00.790713 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:00.790633    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf" podStartSLOduration=0.776274591 podStartE2EDuration="3.790619718s" totalImagesPullingTime="3.014345127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:14:00.789226739 +0000 UTC m=+372.353679692" watchObservedRunningTime="2026-07-29 00:14:00.790619718 +0000 UTC m=+372.355072750"
Jul 29 00:14:01.392269 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:01.392233    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:14:01.393598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:01.393569    2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 29 00:14:01.393757 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:01.393641    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" podUID="ba378fe6-6682-47e7-b43a-c16d5af74606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 29 00:14:01.466513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:01.466483    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:14:01.470937 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:01.470915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:14:01.759963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:01.759879    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:14:01.760894 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:01.760878    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf"
Jul 29 00:14:01.806918 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:01.806886    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"]
Jul 29 00:14:02.392136 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:02.392100    2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 29 00:14:02.392310 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:02.392169    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" podUID="ba378fe6-6682-47e7-b43a-c16d5af74606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 29 00:14:03.392454 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:03.392407    2559 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 29 00:14:03.392876 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:03.392471    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" podUID="ba378fe6-6682-47e7-b43a-c16d5af74606" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 29 00:14:03.768792 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:03.768652    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" podUID="ba378fe6-6682-47e7-b43a-c16d5af74606" containerName="istio-proxy" containerID="cri-o://df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572" gracePeriod=30
Jul 29 00:14:09.046394 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.046368    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:14:09.145508 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba378fe6-6682-47e7-b43a-c16d5af74606-istiod-ca-cert\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.145653 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145564    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-envoy\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.145653 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145597    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-token\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.145653 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145637    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-credential-socket\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.145824 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145680    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-podinfo\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.145824 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145703    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-certs\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.145824 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145732    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-socket\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.145824 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145766    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfpvq\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-kube-api-access-qfpvq\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.145824 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145780    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba378fe6-6682-47e7-b43a-c16d5af74606-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:14:09.145824 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145823    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-data\") pod \"ba378fe6-6682-47e7-b43a-c16d5af74606\" (UID: \"ba378fe6-6682-47e7-b43a-c16d5af74606\") "
Jul 29 00:14:09.146109 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:14:09.146109 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.145996    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:14:09.146109 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.146029    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:14:09.146109 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.146093    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba378fe6-6682-47e7-b43a-c16d5af74606-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.146304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.146111    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.146304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.146124    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.146304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.146132    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.146304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.146190    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:14:09.148049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.148023    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-kube-api-access-qfpvq" (OuterVolumeSpecName: "kube-api-access-qfpvq") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "kube-api-access-qfpvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:14:09.148049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.148041    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:14:09.148196 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.148078    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:14:09.148196 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.148112    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba378fe6-6682-47e7-b43a-c16d5af74606" (UID: "ba378fe6-6682-47e7-b43a-c16d5af74606"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:14:09.174660 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.174614    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:09.246552 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.246518    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.246552 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.246546    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfpvq\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-kube-api-access-qfpvq\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.246552 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.246556    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.246796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.246565    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.246796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.246573    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba378fe6-6682-47e7-b43a-c16d5af74606-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:09.275126 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.275093    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:09.318706 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.318621    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hshqk"]
Jul 29 00:14:09.319009 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.318995    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba378fe6-6682-47e7-b43a-c16d5af74606" containerName="istio-proxy"
Jul 29 00:14:09.319073 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.319011    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba378fe6-6682-47e7-b43a-c16d5af74606" containerName="istio-proxy"
Jul 29 00:14:09.319112 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.319096    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba378fe6-6682-47e7-b43a-c16d5af74606" containerName="istio-proxy"
Jul 29 00:14:09.321015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.320996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hshqk"
Jul 29 00:14:09.323826 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.323804    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 00:14:09.323932 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.323834    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 00:14:09.324771 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.324750    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fwdhj\""
Jul 29 00:14:09.333880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.333858    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hshqk"]
Jul 29 00:14:09.347584 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.347551    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqj4l\" (UniqueName: \"kubernetes.io/projected/6a62c67f-cd9b-409c-aacc-9023136a3dbb-kube-api-access-lqj4l\") pod \"kuadrant-operator-catalog-hshqk\" (UID: \"6a62c67f-cd9b-409c-aacc-9023136a3dbb\") " pod="kuadrant-system/kuadrant-operator-catalog-hshqk"
Jul 29 00:14:09.371796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.371756    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:09.448916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.448886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqj4l\" (UniqueName: \"kubernetes.io/projected/6a62c67f-cd9b-409c-aacc-9023136a3dbb-kube-api-access-lqj4l\") pod \"kuadrant-operator-catalog-hshqk\" (UID: \"6a62c67f-cd9b-409c-aacc-9023136a3dbb\") " pod="kuadrant-system/kuadrant-operator-catalog-hshqk"
Jul 29 00:14:09.456729 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.456704    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqj4l\" (UniqueName: \"kubernetes.io/projected/6a62c67f-cd9b-409c-aacc-9023136a3dbb-kube-api-access-lqj4l\") pod \"kuadrant-operator-catalog-hshqk\" (UID: \"6a62c67f-cd9b-409c-aacc-9023136a3dbb\") " pod="kuadrant-system/kuadrant-operator-catalog-hshqk"
Jul 29 00:14:09.631315 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.631287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hshqk"
Jul 29 00:14:09.681769 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.681739    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hshqk"]
Jul 29 00:14:09.758214 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.758189    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hshqk"]
Jul 29 00:14:09.759641 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:14:09.759615    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a62c67f_cd9b_409c_aacc_9023136a3dbb.slice/crio-091b8252202edae39a42a3c20fdfb518f247486974e78e347f8eec2067ba1a29 WatchSource:0}: Error finding container 091b8252202edae39a42a3c20fdfb518f247486974e78e347f8eec2067ba1a29: Status 404 returned error can't find the container with id 091b8252202edae39a42a3c20fdfb518f247486974e78e347f8eec2067ba1a29
Jul 29 00:14:09.794057 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.794027    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba378fe6-6682-47e7-b43a-c16d5af74606" containerID="df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572" exitCode=0
Jul 29 00:14:09.794189 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.794083    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"
Jul 29 00:14:09.794189 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.794114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" event={"ID":"ba378fe6-6682-47e7-b43a-c16d5af74606","Type":"ContainerDied","Data":"df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572"}
Jul 29 00:14:09.794189 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.794161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x" event={"ID":"ba378fe6-6682-47e7-b43a-c16d5af74606","Type":"ContainerDied","Data":"5e008e9652ba76268cf6de91dacae94cdc3d21543365e406469696add5918499"}
Jul 29 00:14:09.794329 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.794192    2559 scope.go:117] "RemoveContainer" containerID="df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572"
Jul 29 00:14:09.795314 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.795281    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hshqk" event={"ID":"6a62c67f-cd9b-409c-aacc-9023136a3dbb","Type":"ContainerStarted","Data":"091b8252202edae39a42a3c20fdfb518f247486974e78e347f8eec2067ba1a29"}
Jul 29 00:14:09.802768 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.802749    2559 scope.go:117] "RemoveContainer" containerID="df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572"
Jul 29 00:14:09.802995 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:14:09.802978    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572\": container with ID starting with df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572 not found: ID does not exist" containerID="df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572"
Jul 29 00:14:09.803063 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.803005    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572"} err="failed to get container status \"df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572\": rpc error: code = NotFound desc = could not find container \"df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572\": container with ID starting with df597e785f54c1b3ddbee4d8131b3265de44b96287c0b49bfaf3d08c21fdc572 not found: ID does not exist"
Jul 29 00:14:09.815605 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.815580    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"]
Jul 29 00:14:09.821067 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.821047    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcdf52x"]
Jul 29 00:14:09.891578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.891521    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zzvfv"]
Jul 29 00:14:09.894564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.894549    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:09.901632 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.901608    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zzvfv"]
Jul 29 00:14:09.952364 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:09.952326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjcxt\" (UniqueName: \"kubernetes.io/projected/54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca-kube-api-access-cjcxt\") pod \"kuadrant-operator-catalog-zzvfv\" (UID: \"54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca\") " pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:10.052998 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:10.052971    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjcxt\" (UniqueName: \"kubernetes.io/projected/54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca-kube-api-access-cjcxt\") pod \"kuadrant-operator-catalog-zzvfv\" (UID: \"54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca\") " pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:10.061101 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:10.061078    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjcxt\" (UniqueName: \"kubernetes.io/projected/54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca-kube-api-access-cjcxt\") pod \"kuadrant-operator-catalog-zzvfv\" (UID: \"54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca\") " pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:10.113330 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:10.113305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:10.204453 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:10.204371    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:10.327191 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:10.327161    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:10.336476 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:10.336452    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zzvfv"]
Jul 29 00:14:10.338226 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:14:10.338201    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54cf5cd7_e4b8_4a7e_8031_d13a7cf735ca.slice/crio-d7e8888063e2a86b7067efa56a9b469596d1753f1bf8c58d7f362f7d4a404cdd WatchSource:0}: Error finding container d7e8888063e2a86b7067efa56a9b469596d1753f1bf8c58d7f362f7d4a404cdd: Status 404 returned error can't find the container with id d7e8888063e2a86b7067efa56a9b469596d1753f1bf8c58d7f362f7d4a404cdd
Jul 29 00:14:10.801650 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:10.801610    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv" event={"ID":"54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca","Type":"ContainerStarted","Data":"d7e8888063e2a86b7067efa56a9b469596d1753f1bf8c58d7f362f7d4a404cdd"}
Jul 29 00:14:11.021076 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:11.021036    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba378fe6-6682-47e7-b43a-c16d5af74606" path="/var/lib/kubelet/pods/ba378fe6-6682-47e7-b43a-c16d5af74606/volumes"
Jul 29 00:14:12.812106 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:12.812072    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hshqk" event={"ID":"6a62c67f-cd9b-409c-aacc-9023136a3dbb","Type":"ContainerStarted","Data":"443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1"}
Jul 29 00:14:12.812580 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:12.812125    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hshqk" podUID="6a62c67f-cd9b-409c-aacc-9023136a3dbb" containerName="registry-server" containerID="cri-o://443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1" gracePeriod=2
Jul 29 00:14:12.813783 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:12.813756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv" event={"ID":"54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca","Type":"ContainerStarted","Data":"b867942aa0ff4e04a287767623e2663d1315e659afff8d5e68a030268f83ae2d"}
Jul 29 00:14:12.828844 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:12.828806    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hshqk" podStartSLOduration=1.649814135 podStartE2EDuration="3.828791427s" totalImagesPullingTime="2.178977292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:14:12.828056785 +0000 UTC m=+384.392509737" watchObservedRunningTime="2026-07-29 00:14:12.828791427 +0000 UTC m=+384.393244379"
Jul 29 00:14:12.843172 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:12.843127    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv" podStartSLOduration=2.239627298 podStartE2EDuration="3.843112594s" totalImagesPullingTime="1.603485296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:14:12.842743446 +0000 UTC m=+384.407196399" watchObservedRunningTime="2026-07-29 00:14:12.843112594 +0000 UTC m=+384.407565546"
Jul 29 00:14:13.060293 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.060271    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hshqk"
Jul 29 00:14:13.075286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.075234    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqj4l\" (UniqueName: \"kubernetes.io/projected/6a62c67f-cd9b-409c-aacc-9023136a3dbb-kube-api-access-lqj4l\") pod \"6a62c67f-cd9b-409c-aacc-9023136a3dbb\" (UID: \"6a62c67f-cd9b-409c-aacc-9023136a3dbb\") "
Jul 29 00:14:13.077725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.077694    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a62c67f-cd9b-409c-aacc-9023136a3dbb-kube-api-access-lqj4l" (OuterVolumeSpecName: "kube-api-access-lqj4l") pod "6a62c67f-cd9b-409c-aacc-9023136a3dbb" (UID: "6a62c67f-cd9b-409c-aacc-9023136a3dbb"). InnerVolumeSpecName "kube-api-access-lqj4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:14:13.176020 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.175988    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqj4l\" (UniqueName: \"kubernetes.io/projected/6a62c67f-cd9b-409c-aacc-9023136a3dbb-kube-api-access-lqj4l\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:14:13.819782 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.819744    2559 generic.go:356] "Generic (PLEG): container finished" podID="6a62c67f-cd9b-409c-aacc-9023136a3dbb" containerID="443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1" exitCode=0
Jul 29 00:14:13.820241 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.819788    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hshqk"
Jul 29 00:14:13.820241 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.819830    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hshqk" event={"ID":"6a62c67f-cd9b-409c-aacc-9023136a3dbb","Type":"ContainerDied","Data":"443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1"}
Jul 29 00:14:13.820241 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.819870    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hshqk" event={"ID":"6a62c67f-cd9b-409c-aacc-9023136a3dbb","Type":"ContainerDied","Data":"091b8252202edae39a42a3c20fdfb518f247486974e78e347f8eec2067ba1a29"}
Jul 29 00:14:13.820241 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.819898    2559 scope.go:117] "RemoveContainer" containerID="443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1"
Jul 29 00:14:13.829376 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.829360    2559 scope.go:117] "RemoveContainer" containerID="443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1"
Jul 29 00:14:13.829631 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:14:13.829612    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1\": container with ID starting with 443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1 not found: ID does not exist" containerID="443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1"
Jul 29 00:14:13.829734 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.829638    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1"} err="failed to get container status \"443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1\": rpc error: code = NotFound desc = could not find container \"443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1\": container with ID starting with 443ddeb7746e9fdc8b5a0bdbc5a39b9f9d3c74dcc0cd2c31521c77a6e114b5a1 not found: ID does not exist"
Jul 29 00:14:13.840927 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.840906    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hshqk"]
Jul 29 00:14:13.845498 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:13.845477    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hshqk"]
Jul 29 00:14:15.009865 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:15.009832    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a62c67f-cd9b-409c-aacc-9023136a3dbb" path="/var/lib/kubelet/pods/6a62c67f-cd9b-409c-aacc-9023136a3dbb/volumes"
Jul 29 00:14:20.205446 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:20.205405    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:20.205882 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:20.205470    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:20.227199 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:20.227174    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:20.879615 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:20.879591    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zzvfv"
Jul 29 00:14:30.227564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:30.227524    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:30.288047 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:30.288017    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:34.304341 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:34.304308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:34.900119 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:34.900079    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:35.948647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:35.948597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:38.044878 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.044844    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"]
Jul 29 00:14:38.045242 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.045155    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a62c67f-cd9b-409c-aacc-9023136a3dbb" containerName="registry-server"
Jul 29 00:14:38.045242 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.045166    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a62c67f-cd9b-409c-aacc-9023136a3dbb" containerName="registry-server"
Jul 29 00:14:38.045242 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.045230    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a62c67f-cd9b-409c-aacc-9023136a3dbb" containerName="registry-server"
Jul 29 00:14:38.052228 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.052208    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"
Jul 29 00:14:38.056459 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.056440    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-95gj6\""
Jul 29 00:14:38.066796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.066774    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"]
Jul 29 00:14:38.178844 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.178808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lvs\" (UniqueName: \"kubernetes.io/projected/4e53ab92-bba1-408c-9824-1153ba18462e-kube-api-access-82lvs\") pod \"authorino-operator-75cc8d5cb7-6p6lp\" (UID: \"4e53ab92-bba1-408c-9824-1153ba18462e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"
Jul 29 00:14:38.280031 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.279995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82lvs\" (UniqueName: \"kubernetes.io/projected/4e53ab92-bba1-408c-9824-1153ba18462e-kube-api-access-82lvs\") pod \"authorino-operator-75cc8d5cb7-6p6lp\" (UID: \"4e53ab92-bba1-408c-9824-1153ba18462e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"
Jul 29 00:14:38.290278 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.290245    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lvs\" (UniqueName: \"kubernetes.io/projected/4e53ab92-bba1-408c-9824-1153ba18462e-kube-api-access-82lvs\") pod \"authorino-operator-75cc8d5cb7-6p6lp\" (UID: \"4e53ab92-bba1-408c-9824-1153ba18462e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"
Jul 29 00:14:38.362987 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.362891    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"
Jul 29 00:14:38.502927 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.502895    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"]
Jul 29 00:14:38.506228 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:14:38.506204    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e53ab92_bba1_408c_9824_1153ba18462e.slice/crio-4b63b47e00d92f29fe10724a99b85d18d049a1f6791dc820a9b4d386ded35bb3 WatchSource:0}: Error finding container 4b63b47e00d92f29fe10724a99b85d18d049a1f6791dc820a9b4d386ded35bb3: Status 404 returned error can't find the container with id 4b63b47e00d92f29fe10724a99b85d18d049a1f6791dc820a9b4d386ded35bb3
Jul 29 00:14:38.936101 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:38.936064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp" event={"ID":"4e53ab92-bba1-408c-9824-1153ba18462e","Type":"ContainerStarted","Data":"4b63b47e00d92f29fe10724a99b85d18d049a1f6791dc820a9b4d386ded35bb3"}
Jul 29 00:14:39.708444 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:39.708396    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:39.940489 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:39.940446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:40.036523 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:40.036423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:40.372802 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:40.372766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:40.471631 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:40.471595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:41.951484 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:41.951449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp" event={"ID":"4e53ab92-bba1-408c-9824-1153ba18462e","Type":"ContainerStarted","Data":"4f920612416c59749660a18e7d1061a2eb1e4193a582356246c3fbffe7611202"}
Jul 29 00:14:41.951871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:41.951590    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"
Jul 29 00:14:41.969519 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:41.969474    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp" podStartSLOduration=1.49945177 podStartE2EDuration="3.96946047s" totalImagesPullingTime="2.4700087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:14:41.968910956 +0000 UTC m=+413.533363909" watchObservedRunningTime="2026-07-29 00:14:41.96946047 +0000 UTC m=+413.533913421"
Jul 29 00:14:43.023185 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.023155    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"]
Jul 29 00:14:43.026468 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.026448    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"
Jul 29 00:14:43.029925 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.029904    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 29 00:14:43.030044 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.029907    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pcqw8\""
Jul 29 00:14:43.038572 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.038550    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"]
Jul 29 00:14:43.125388 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.125351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lqq7\" (UniqueName: \"kubernetes.io/projected/8fd68fea-e153-43d3-9e45-a1874520dfbc-kube-api-access-7lqq7\") pod \"dns-operator-controller-manager-864dd78c4c-bdf25\" (UID: \"8fd68fea-e153-43d3-9e45-a1874520dfbc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"
Jul 29 00:14:43.226844 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.226806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lqq7\" (UniqueName: \"kubernetes.io/projected/8fd68fea-e153-43d3-9e45-a1874520dfbc-kube-api-access-7lqq7\") pod \"dns-operator-controller-manager-864dd78c4c-bdf25\" (UID: \"8fd68fea-e153-43d3-9e45-a1874520dfbc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"
Jul 29 00:14:43.245220 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.245189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lqq7\" (UniqueName: \"kubernetes.io/projected/8fd68fea-e153-43d3-9e45-a1874520dfbc-kube-api-access-7lqq7\") pod \"dns-operator-controller-manager-864dd78c4c-bdf25\" (UID: \"8fd68fea-e153-43d3-9e45-a1874520dfbc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"
Jul 29 00:14:43.337035 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.336956    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"
Jul 29 00:14:43.475520 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.475496    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"]
Jul 29 00:14:43.477381 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:14:43.477359    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd68fea_e153_43d3_9e45_a1874520dfbc.slice/crio-bc271d40cbabc81dc1a3ca88216534f80ee89ba63490a888a6b794493dcee447 WatchSource:0}: Error finding container bc271d40cbabc81dc1a3ca88216534f80ee89ba63490a888a6b794493dcee447: Status 404 returned error can't find the container with id bc271d40cbabc81dc1a3ca88216534f80ee89ba63490a888a6b794493dcee447
Jul 29 00:14:43.961118 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:43.961084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25" event={"ID":"8fd68fea-e153-43d3-9e45-a1874520dfbc","Type":"ContainerStarted","Data":"bc271d40cbabc81dc1a3ca88216534f80ee89ba63490a888a6b794493dcee447"}
Jul 29 00:14:44.140711 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:44.140683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:46.176225 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.176188    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"]
Jul 29 00:14:46.179811 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.179790    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:14:46.182977 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.182956    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kzkrh\""
Jul 29 00:14:46.192747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.192726    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"]
Jul 29 00:14:46.253614 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.253583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ngzr\" (UniqueName: \"kubernetes.io/projected/ca870de7-113d-45c6-9a1d-43d261bce7d2-kube-api-access-6ngzr\") pod \"limitador-operator-controller-manager-859d7b78bd-qxggh\" (UID: \"ca870de7-113d-45c6-9a1d-43d261bce7d2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:14:46.354301 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.354225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ngzr\" (UniqueName: \"kubernetes.io/projected/ca870de7-113d-45c6-9a1d-43d261bce7d2-kube-api-access-6ngzr\") pod \"limitador-operator-controller-manager-859d7b78bd-qxggh\" (UID: \"ca870de7-113d-45c6-9a1d-43d261bce7d2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:14:46.368773 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.368746    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ngzr\" (UniqueName: \"kubernetes.io/projected/ca870de7-113d-45c6-9a1d-43d261bce7d2-kube-api-access-6ngzr\") pod \"limitador-operator-controller-manager-859d7b78bd-qxggh\" (UID: \"ca870de7-113d-45c6-9a1d-43d261bce7d2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:14:46.491440 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.491400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:14:46.632760 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.632737    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"]
Jul 29 00:14:46.634190 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:14:46.634168    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca870de7_113d_45c6_9a1d_43d261bce7d2.slice/crio-117d8847973a87577742be630ebd3d899443ec2297206e0ce7a72a0a4a7f28da WatchSource:0}: Error finding container 117d8847973a87577742be630ebd3d899443ec2297206e0ce7a72a0a4a7f28da: Status 404 returned error can't find the container with id 117d8847973a87577742be630ebd3d899443ec2297206e0ce7a72a0a4a7f28da
Jul 29 00:14:46.737567 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.737535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:46.976406 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.976320    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh" event={"ID":"ca870de7-113d-45c6-9a1d-43d261bce7d2","Type":"ContainerStarted","Data":"117d8847973a87577742be630ebd3d899443ec2297206e0ce7a72a0a4a7f28da"}
Jul 29 00:14:46.977875 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.977851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25" event={"ID":"8fd68fea-e153-43d3-9e45-a1874520dfbc","Type":"ContainerStarted","Data":"269a2cf9c9234e4239cdbefadd1a2ba7b16d8a0a6cad06de5b5086e909e2a5f4"}
Jul 29 00:14:46.977991 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:46.977977    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"
Jul 29 00:14:47.001799 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:47.001752    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25" podStartSLOduration=1.473040524 podStartE2EDuration="4.001734381s" totalImagesPullingTime="2.528693857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:14:47.000561854 +0000 UTC m=+418.565014833" watchObservedRunningTime="2026-07-29 00:14:47.001734381 +0000 UTC m=+418.566187334"
Jul 29 00:14:48.555908 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:48.555837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:48.989034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:48.988997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh" event={"ID":"ca870de7-113d-45c6-9a1d-43d261bce7d2","Type":"ContainerStarted","Data":"9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7"}
Jul 29 00:14:48.989214 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:48.989125    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:14:49.006464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:49.006411    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh" podStartSLOduration=1.073661494 podStartE2EDuration="3.006396656s" totalImagesPullingTime="1.932735162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:14:49.005372357 +0000 UTC m=+420.569825301" watchObservedRunningTime="2026-07-29 00:14:49.006396656 +0000 UTC m=+420.570849608"
Jul 29 00:14:49.980062 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:49.980029    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:50.588440 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:50.588411    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c564784d7-sd8xg"]
Jul 29 00:14:50.705023 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:50.704990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:50.807327 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:50.807281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:50.904985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:50.904939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:51.791013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:51.790975    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:52.941764 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:52.941711    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:52.958475 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:52.958449    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-6p6lp"
Jul 29 00:14:53.051992 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:53.051932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:53.389200 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:53.389165    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:53.491159 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:53.491124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:57.321412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:57.321373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:57.425822 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:57.425788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:14:57.985959 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:57.985930    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bdf25"
Jul 29 00:14:59.995259 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:14:59.995227    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:15:01.330965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:01.330929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:01.417275 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:01.417222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:01.479607 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:01.479572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:01.628280 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:01.628246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:04.459536 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:04.459503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:05.050253 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:05.050214    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:12.329613 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.323865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:12.348522 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.348492    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"]
Jul 29 00:15:12.348750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.348728    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh" podUID="ca870de7-113d-45c6-9a1d-43d261bce7d2" containerName="manager" containerID="cri-o://9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7" gracePeriod=2
Jul 29 00:15:12.359088 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.359060    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"]
Jul 29 00:15:12.362826 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:15:12.362629    2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ca870de7-113d-45c6-9a1d-43d261bce7d2\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-qxggh\": pods \"limitador-operator-controller-manager-859d7b78bd-qxggh\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:15:12.376739 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.376712    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"]
Jul 29 00:15:12.377061 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.377050    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca870de7-113d-45c6-9a1d-43d261bce7d2" containerName="manager"
Jul 29 00:15:12.377107 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.377063    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca870de7-113d-45c6-9a1d-43d261bce7d2" containerName="manager"
Jul 29 00:15:12.377141 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.377126    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca870de7-113d-45c6-9a1d-43d261bce7d2" containerName="manager"
Jul 29 00:15:12.380098 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.380076    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"
Jul 29 00:15:12.400841 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.400817    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"]
Jul 29 00:15:12.422402 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:15:12.422364    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qxggh\" is forbidden: User \"system:node:ip-10-0-131-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-68.ec2.internal' and this object" podUID="ca870de7-113d-45c6-9a1d-43d261bce7d2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:15:12.425945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.425582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:12.475910 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.475882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szp7k\" (UniqueName: \"kubernetes.io/projected/f9c52177-c3bd-40be-b40b-8867c8206f28-kube-api-access-szp7k\") pod \"limitador-operator-controller-manager-859d7b78bd-vldzf\" (UID: \"f9c52177-c3bd-40be-b40b-8867c8206f28\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"
Jul 29 00:15:12.526745 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.526713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:12.577051 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.576875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szp7k\" (UniqueName: \"kubernetes.io/projected/f9c52177-c3bd-40be-b40b-8867c8206f28-kube-api-access-szp7k\") pod \"limitador-operator-controller-manager-859d7b78bd-vldzf\" (UID: \"f9c52177-c3bd-40be-b40b-8867c8206f28\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"
Jul 29 00:15:12.588963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.588939    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szp7k\" (UniqueName: \"kubernetes.io/projected/f9c52177-c3bd-40be-b40b-8867c8206f28-kube-api-access-szp7k\") pod \"limitador-operator-controller-manager-859d7b78bd-vldzf\" (UID: \"f9c52177-c3bd-40be-b40b-8867c8206f28\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"
Jul 29 00:15:12.604432 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.604409    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:15:12.607091 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:15:12.607064    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qxggh\" is forbidden: User \"system:node:ip-10-0-131-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-68.ec2.internal' and this object" podUID="ca870de7-113d-45c6-9a1d-43d261bce7d2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:15:12.627097 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.627061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:12.678215 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.678181    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ngzr\" (UniqueName: \"kubernetes.io/projected/ca870de7-113d-45c6-9a1d-43d261bce7d2-kube-api-access-6ngzr\") pod \"ca870de7-113d-45c6-9a1d-43d261bce7d2\" (UID: \"ca870de7-113d-45c6-9a1d-43d261bce7d2\") "
Jul 29 00:15:12.680411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.680387    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca870de7-113d-45c6-9a1d-43d261bce7d2-kube-api-access-6ngzr" (OuterVolumeSpecName: "kube-api-access-6ngzr") pod "ca870de7-113d-45c6-9a1d-43d261bce7d2" (UID: "ca870de7-113d-45c6-9a1d-43d261bce7d2"). InnerVolumeSpecName "kube-api-access-6ngzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:15:12.729607 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.729569    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"
Jul 29 00:15:12.779359 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.779108    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ngzr\" (UniqueName: \"kubernetes.io/projected/ca870de7-113d-45c6-9a1d-43d261bce7d2-kube-api-access-6ngzr\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:12.888852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:12.888825    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"]
Jul 29 00:15:12.891592 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:15:12.891566    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c52177_c3bd_40be_b40b_8867c8206f28.slice/crio-e1459832d62ed01b3ebc1c3484cdf0f65cfb17f77f563c4548469f8d4c2e3dd5 WatchSource:0}: Error finding container e1459832d62ed01b3ebc1c3484cdf0f65cfb17f77f563c4548469f8d4c2e3dd5: Status 404 returned error can't find the container with id e1459832d62ed01b3ebc1c3484cdf0f65cfb17f77f563c4548469f8d4c2e3dd5
Jul 29 00:15:13.011163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.011131    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca870de7-113d-45c6-9a1d-43d261bce7d2" path="/var/lib/kubelet/pods/ca870de7-113d-45c6-9a1d-43d261bce7d2/volumes"
Jul 29 00:15:13.099161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.099124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf" event={"ID":"f9c52177-c3bd-40be-b40b-8867c8206f28","Type":"ContainerStarted","Data":"a31333a1da77a1f81706ac0b468673a80a79418a8e408831310ecf419b2caf6e"}
Jul 29 00:15:13.099348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.099179    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf" event={"ID":"f9c52177-c3bd-40be-b40b-8867c8206f28","Type":"ContainerStarted","Data":"e1459832d62ed01b3ebc1c3484cdf0f65cfb17f77f563c4548469f8d4c2e3dd5"}
Jul 29 00:15:13.099348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.099237    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"
Jul 29 00:15:13.100757 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.100720    2559 generic.go:356] "Generic (PLEG): container finished" podID="ca870de7-113d-45c6-9a1d-43d261bce7d2" containerID="9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7" exitCode=0
Jul 29 00:15:13.100881 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.100732    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qxggh"
Jul 29 00:15:13.100881 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.100776    2559 scope.go:117] "RemoveContainer" containerID="9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7"
Jul 29 00:15:13.109982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.109961    2559 scope.go:117] "RemoveContainer" containerID="9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7"
Jul 29 00:15:13.110285 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:15:13.110268    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7\": container with ID starting with 9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7 not found: ID does not exist" containerID="9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7"
Jul 29 00:15:13.110337 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.110293    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7"} err="failed to get container status \"9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7\": rpc error: code = NotFound desc = could not find container \"9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7\": container with ID starting with 9c0d3374d202cf235a4f9fd1e01e9ab254b5be240f4fe1f73ea1986e3f3221d7 not found: ID does not exist"
Jul 29 00:15:13.122788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.122740    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf" podStartSLOduration=1.122725309 podStartE2EDuration="1.122725309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:15:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:15:13.120940277 +0000 UTC m=+444.685393229" watchObservedRunningTime="2026-07-29 00:15:13.122725309 +0000 UTC m=+444.687178260"
Jul 29 00:15:13.489212 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.489177    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"]
Jul 29 00:15:13.493843 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.493823    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:13.497222 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.497199    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-psdv4\""
Jul 29 00:15:13.506433 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.506407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"]
Jul 29 00:15:13.586926 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.586877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbl7r\" (UniqueName: \"kubernetes.io/projected/10d1813e-c27c-4916-b7aa-d49fda3d964a-kube-api-access-sbl7r\") pod \"kuadrant-operator-controller-manager-86878c769f-pt87s\" (UID: \"10d1813e-c27c-4916-b7aa-d49fda3d964a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:13.587102 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.586942    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10d1813e-c27c-4916-b7aa-d49fda3d964a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pt87s\" (UID: \"10d1813e-c27c-4916-b7aa-d49fda3d964a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:13.688308 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.688266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10d1813e-c27c-4916-b7aa-d49fda3d964a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pt87s\" (UID: \"10d1813e-c27c-4916-b7aa-d49fda3d964a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:13.688489 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.688357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbl7r\" (UniqueName: \"kubernetes.io/projected/10d1813e-c27c-4916-b7aa-d49fda3d964a-kube-api-access-sbl7r\") pod \"kuadrant-operator-controller-manager-86878c769f-pt87s\" (UID: \"10d1813e-c27c-4916-b7aa-d49fda3d964a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:13.688657 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.688638    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10d1813e-c27c-4916-b7aa-d49fda3d964a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pt87s\" (UID: \"10d1813e-c27c-4916-b7aa-d49fda3d964a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:13.700447 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.700414    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbl7r\" (UniqueName: \"kubernetes.io/projected/10d1813e-c27c-4916-b7aa-d49fda3d964a-kube-api-access-sbl7r\") pod \"kuadrant-operator-controller-manager-86878c769f-pt87s\" (UID: \"10d1813e-c27c-4916-b7aa-d49fda3d964a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:13.804190 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.804087    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:13.946915 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:13.946888    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"]
Jul 29 00:15:13.949434 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:15:13.949409    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d1813e_c27c_4916_b7aa_d49fda3d964a.slice/crio-552cc0c9e1e566419cbcb4e445796ac627f26c7c867e3bde0237bc4cc537ccdb WatchSource:0}: Error finding container 552cc0c9e1e566419cbcb4e445796ac627f26c7c867e3bde0237bc4cc537ccdb: Status 404 returned error can't find the container with id 552cc0c9e1e566419cbcb4e445796ac627f26c7c867e3bde0237bc4cc537ccdb
Jul 29 00:15:14.107522 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:14.107436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s" event={"ID":"10d1813e-c27c-4916-b7aa-d49fda3d964a","Type":"ContainerStarted","Data":"552cc0c9e1e566419cbcb4e445796ac627f26c7c867e3bde0237bc4cc537ccdb"}
Jul 29 00:15:14.109338 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:14.109313    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:14.203042 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:14.203003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:15.610126 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.610081    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c564784d7-sd8xg" podUID="bb835170-4266-4265-9389-56fc46e4227e" containerName="console" containerID="cri-o://81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043" gracePeriod=15
Jul 29 00:15:15.880273 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.880252    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:15:15.910662 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.910629    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-oauth-config\") pod \"bb835170-4266-4265-9389-56fc46e4227e\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") "
Jul 29 00:15:15.910830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.910717    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz9sv\" (UniqueName: \"kubernetes.io/projected/bb835170-4266-4265-9389-56fc46e4227e-kube-api-access-jz9sv\") pod \"bb835170-4266-4265-9389-56fc46e4227e\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") "
Jul 29 00:15:15.910830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.910758    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-oauth-serving-cert\") pod \"bb835170-4266-4265-9389-56fc46e4227e\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") "
Jul 29 00:15:15.910830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.910805    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-serving-cert\") pod \"bb835170-4266-4265-9389-56fc46e4227e\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") "
Jul 29 00:15:15.911188 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.910836    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-trusted-ca-bundle\") pod \"bb835170-4266-4265-9389-56fc46e4227e\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") "
Jul 29 00:15:15.911188 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.910877    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-service-ca\") pod \"bb835170-4266-4265-9389-56fc46e4227e\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") "
Jul 29 00:15:15.911188 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.910945    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-console-config\") pod \"bb835170-4266-4265-9389-56fc46e4227e\" (UID: \"bb835170-4266-4265-9389-56fc46e4227e\") "
Jul 29 00:15:15.911188 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.911161    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb835170-4266-4265-9389-56fc46e4227e" (UID: "bb835170-4266-4265-9389-56fc46e4227e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:15:15.911466 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.911441    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb835170-4266-4265-9389-56fc46e4227e" (UID: "bb835170-4266-4265-9389-56fc46e4227e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:15:15.911549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.911474    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-console-config" (OuterVolumeSpecName: "console-config") pod "bb835170-4266-4265-9389-56fc46e4227e" (UID: "bb835170-4266-4265-9389-56fc46e4227e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:15:15.911549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.911470    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bb835170-4266-4265-9389-56fc46e4227e" (UID: "bb835170-4266-4265-9389-56fc46e4227e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:15:15.913498 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.913473    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb835170-4266-4265-9389-56fc46e4227e" (UID: "bb835170-4266-4265-9389-56fc46e4227e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:15:15.913749 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.913722    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb835170-4266-4265-9389-56fc46e4227e" (UID: "bb835170-4266-4265-9389-56fc46e4227e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:15:15.913749 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:15.913732    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb835170-4266-4265-9389-56fc46e4227e-kube-api-access-jz9sv" (OuterVolumeSpecName: "kube-api-access-jz9sv") pod "bb835170-4266-4265-9389-56fc46e4227e" (UID: "bb835170-4266-4265-9389-56fc46e4227e"). InnerVolumeSpecName "kube-api-access-jz9sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:15:16.012624 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.012585    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-console-config\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:16.012624 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.012619    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-oauth-config\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:16.012624 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.012630    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz9sv\" (UniqueName: \"kubernetes.io/projected/bb835170-4266-4265-9389-56fc46e4227e-kube-api-access-jz9sv\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:16.012947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.012638    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-oauth-serving-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:16.012947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.012650    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb835170-4266-4265-9389-56fc46e4227e-console-serving-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:16.012947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.012677    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-trusted-ca-bundle\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:16.012947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.012691    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb835170-4266-4265-9389-56fc46e4227e-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:16.119373 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.119335    2559 generic.go:356] "Generic (PLEG): container finished" podID="bb835170-4266-4265-9389-56fc46e4227e" containerID="81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043" exitCode=0
Jul 29 00:15:16.119540 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.119455    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c564784d7-sd8xg"
Jul 29 00:15:16.119540 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.119465    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c564784d7-sd8xg" event={"ID":"bb835170-4266-4265-9389-56fc46e4227e","Type":"ContainerDied","Data":"81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043"}
Jul 29 00:15:16.119540 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.119515    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c564784d7-sd8xg" event={"ID":"bb835170-4266-4265-9389-56fc46e4227e","Type":"ContainerDied","Data":"ccf0d28b5e8b1869d070e9fdcddcd40f3d14d4070b87a82bd63f17523774c740"}
Jul 29 00:15:16.119758 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.119545    2559 scope.go:117] "RemoveContainer" containerID="81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043"
Jul 29 00:15:16.130449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.130423    2559 scope.go:117] "RemoveContainer" containerID="81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043"
Jul 29 00:15:16.130801 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:15:16.130779    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043\": container with ID starting with 81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043 not found: ID does not exist" containerID="81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043"
Jul 29 00:15:16.130893 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.130810    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043"} err="failed to get container status \"81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043\": rpc error: code = NotFound desc = could not find container \"81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043\": container with ID starting with 81b0e200bbd83650473ef0b16d170cd16073a434ba70fa0c2742130200823043 not found: ID does not exist"
Jul 29 00:15:16.145163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.145134    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c564784d7-sd8xg"]
Jul 29 00:15:16.149350 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:16.149327    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c564784d7-sd8xg"]
Jul 29 00:15:17.010455 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:17.010410    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb835170-4266-4265-9389-56fc46e4227e" path="/var/lib/kubelet/pods/bb835170-4266-4265-9389-56fc46e4227e/volumes"
Jul 29 00:15:18.782089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:18.782053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:18.881751 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:18.881722    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:19.137342 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:19.137247    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s" event={"ID":"10d1813e-c27c-4916-b7aa-d49fda3d964a","Type":"ContainerStarted","Data":"f77093729ee9a54f4726867496f36764936928da0031e58b447697c01b35203a"}
Jul 29 00:15:19.137502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:19.137386    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:19.161249 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:19.161196    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s" podStartSLOduration=1.560512706 podStartE2EDuration="6.161178178s" totalImagesPullingTime="4.600665472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:15:19.158049114 +0000 UTC m=+450.722502057" watchObservedRunningTime="2026-07-29 00:15:19.161178178 +0000 UTC m=+450.725631131"
Jul 29 00:15:22.235145 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:22.235113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:22.334764 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:22.334728    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:24.110240 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:24.110213    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vldzf"
Jul 29 00:15:30.085591 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:30.085550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:30.144387 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:30.144363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:15:30.183299 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:30.183260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:30.685439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:30.685411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:30.793399 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:30.793308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:33.079646 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:33.079607    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:33.136433 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:33.136401    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:38.277090 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:38.277053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:38.377701 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:38.377650    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:40.805758 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:40.805727    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:40.905740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:40.905703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:46.672206 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:46.672164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:47.007984 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:47.007896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:51.905622 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:51.905576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:52.002985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.002942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:52.102718 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.102683    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:52.681061 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.681027    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zqc5j"]
Jul 29 00:15:52.681362 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.681350    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb835170-4266-4265-9389-56fc46e4227e" containerName="console"
Jul 29 00:15:52.681408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.681364    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb835170-4266-4265-9389-56fc46e4227e" containerName="console"
Jul 29 00:15:52.681486 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.681453    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb835170-4266-4265-9389-56fc46e4227e" containerName="console"
Jul 29 00:15:52.683996 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.683980    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zqc5j"
Jul 29 00:15:52.686628 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.686605    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8t4kk\""
Jul 29 00:15:52.688542 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.688523    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zqc5j"]
Jul 29 00:15:52.708714 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.708656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:52.790966 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.790927    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:52.818282 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.818251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsc4h\" (UniqueName: \"kubernetes.io/projected/fb665f96-df0c-447a-8d3a-252463f9f138-kube-api-access-jsc4h\") pod \"authorino-58cd955675-zqc5j\" (UID: \"fb665f96-df0c-447a-8d3a-252463f9f138\") " pod="kuadrant-system/authorino-58cd955675-zqc5j"
Jul 29 00:15:52.919049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.919007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsc4h\" (UniqueName: \"kubernetes.io/projected/fb665f96-df0c-447a-8d3a-252463f9f138-kube-api-access-jsc4h\") pod \"authorino-58cd955675-zqc5j\" (UID: \"fb665f96-df0c-447a-8d3a-252463f9f138\") " pod="kuadrant-system/authorino-58cd955675-zqc5j"
Jul 29 00:15:52.928083 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.928048    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsc4h\" (UniqueName: \"kubernetes.io/projected/fb665f96-df0c-447a-8d3a-252463f9f138-kube-api-access-jsc4h\") pod \"authorino-58cd955675-zqc5j\" (UID: \"fb665f96-df0c-447a-8d3a-252463f9f138\") " pod="kuadrant-system/authorino-58cd955675-zqc5j"
Jul 29 00:15:52.994426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:52.994338    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zqc5j"
Jul 29 00:15:53.144924 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:53.144866    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zqc5j"]
Jul 29 00:15:53.147052 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:15:53.147025    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb665f96_df0c_447a_8d3a_252463f9f138.slice/crio-d731ce467df244661c8e6627e68eb0d55975bddc2bdb3ac0b97f8098f2d2a233 WatchSource:0}: Error finding container d731ce467df244661c8e6627e68eb0d55975bddc2bdb3ac0b97f8098f2d2a233: Status 404 returned error can't find the container with id d731ce467df244661c8e6627e68eb0d55975bddc2bdb3ac0b97f8098f2d2a233
Jul 29 00:15:53.295796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:53.295713    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zqc5j" event={"ID":"fb665f96-df0c-447a-8d3a-252463f9f138","Type":"ContainerStarted","Data":"d731ce467df244661c8e6627e68eb0d55975bddc2bdb3ac0b97f8098f2d2a233"}
Jul 29 00:15:56.314923 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:56.314892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zqc5j" event={"ID":"fb665f96-df0c-447a-8d3a-252463f9f138","Type":"ContainerStarted","Data":"a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6"}
Jul 29 00:15:56.331560 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:56.331511    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zqc5j" podStartSLOduration=1.249386904 podStartE2EDuration="4.331496804s" totalImagesPullingTime="3.0821099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:15:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:15:56.329891582 +0000 UTC m=+487.894344534" watchObservedRunningTime="2026-07-29 00:15:56.331496804 +0000 UTC m=+487.895949756"
Jul 29 00:15:57.911865 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:57.911828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:58.012888 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.012853    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:58.495389 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.495358    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zqc5j"]
Jul 29 00:15:58.495548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.495529    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zqc5j" podUID="fb665f96-df0c-447a-8d3a-252463f9f138" containerName="authorino" containerID="cri-o://a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6" gracePeriod=30
Jul 29 00:15:58.533116 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.533084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:58.589616 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.589581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:15:58.752738 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.752656    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zqc5j"
Jul 29 00:15:58.874166 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.874129    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsc4h\" (UniqueName: \"kubernetes.io/projected/fb665f96-df0c-447a-8d3a-252463f9f138-kube-api-access-jsc4h\") pod \"fb665f96-df0c-447a-8d3a-252463f9f138\" (UID: \"fb665f96-df0c-447a-8d3a-252463f9f138\") "
Jul 29 00:15:58.876623 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.876590    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb665f96-df0c-447a-8d3a-252463f9f138-kube-api-access-jsc4h" (OuterVolumeSpecName: "kube-api-access-jsc4h") pod "fb665f96-df0c-447a-8d3a-252463f9f138" (UID: "fb665f96-df0c-447a-8d3a-252463f9f138"). InnerVolumeSpecName "kube-api-access-jsc4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:15:58.975305 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:58.975267    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsc4h\" (UniqueName: \"kubernetes.io/projected/fb665f96-df0c-447a-8d3a-252463f9f138-kube-api-access-jsc4h\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:15:59.329378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.329299    2559 generic.go:356] "Generic (PLEG): container finished" podID="fb665f96-df0c-447a-8d3a-252463f9f138" containerID="a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6" exitCode=0
Jul 29 00:15:59.329378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.329366    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zqc5j"
Jul 29 00:15:59.329551 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.329381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zqc5j" event={"ID":"fb665f96-df0c-447a-8d3a-252463f9f138","Type":"ContainerDied","Data":"a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6"}
Jul 29 00:15:59.329551 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.329423    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zqc5j" event={"ID":"fb665f96-df0c-447a-8d3a-252463f9f138","Type":"ContainerDied","Data":"d731ce467df244661c8e6627e68eb0d55975bddc2bdb3ac0b97f8098f2d2a233"}
Jul 29 00:15:59.329551 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.329445    2559 scope.go:117] "RemoveContainer" containerID="a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6"
Jul 29 00:15:59.338105 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.338085    2559 scope.go:117] "RemoveContainer" containerID="a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6"
Jul 29 00:15:59.338360 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:15:59.338338    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6\": container with ID starting with a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6 not found: ID does not exist" containerID="a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6"
Jul 29 00:15:59.338430 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.338370    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6"} err="failed to get container status \"a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6\": rpc error: code = NotFound desc = could not find container \"a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6\": container with ID starting with a1c51606a3bf6a17ccc6ec773ec38c5689c5d3a3d121675409105476b711c5e6 not found: ID does not exist"
Jul 29 00:15:59.344410 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.344323    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zqc5j"]
Jul 29 00:15:59.346042 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:15:59.346023    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zqc5j"]
Jul 29 00:16:01.011204 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:01.011172    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb665f96-df0c-447a-8d3a-252463f9f138" path="/var/lib/kubelet/pods/fb665f96-df0c-447a-8d3a-252463f9f138/volumes"
Jul 29 00:16:13.048865 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:13.048823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:13.149612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:13.149576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:13.554702 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:13.554657    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:25.284194 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.284146    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:25.511207 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.511175    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6sbkl"]
Jul 29 00:16:25.511520 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.511508    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb665f96-df0c-447a-8d3a-252463f9f138" containerName="authorino"
Jul 29 00:16:25.511563 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.511521    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb665f96-df0c-447a-8d3a-252463f9f138" containerName="authorino"
Jul 29 00:16:25.511598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.511574    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb665f96-df0c-447a-8d3a-252463f9f138" containerName="authorino"
Jul 29 00:16:25.514603 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.514587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6sbkl"
Jul 29 00:16:25.517299 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.517279    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8t4kk\""
Jul 29 00:16:25.520926 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.520907    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6sbkl"]
Jul 29 00:16:25.594145 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.594070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p52st\" (UniqueName: \"kubernetes.io/projected/11f07dcb-258d-4e2e-815e-b2bf6941ef91-kube-api-access-p52st\") pod \"authorino-5d4b67c446-6sbkl\" (UID: \"11f07dcb-258d-4e2e-815e-b2bf6941ef91\") " pod="kuadrant-system/authorino-5d4b67c446-6sbkl"
Jul 29 00:16:25.694488 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.694461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p52st\" (UniqueName: \"kubernetes.io/projected/11f07dcb-258d-4e2e-815e-b2bf6941ef91-kube-api-access-p52st\") pod \"authorino-5d4b67c446-6sbkl\" (UID: \"11f07dcb-258d-4e2e-815e-b2bf6941ef91\") " pod="kuadrant-system/authorino-5d4b67c446-6sbkl"
Jul 29 00:16:25.702380 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.702353    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p52st\" (UniqueName: \"kubernetes.io/projected/11f07dcb-258d-4e2e-815e-b2bf6941ef91-kube-api-access-p52st\") pod \"authorino-5d4b67c446-6sbkl\" (UID: \"11f07dcb-258d-4e2e-815e-b2bf6941ef91\") " pod="kuadrant-system/authorino-5d4b67c446-6sbkl"
Jul 29 00:16:25.761929 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.761893    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6sbkl"]
Jul 29 00:16:25.762194 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.762178    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6sbkl"
Jul 29 00:16:25.788819 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.788791    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-99f4d967f-qmk2x"]
Jul 29 00:16:25.792253 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.792234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-99f4d967f-qmk2x"
Jul 29 00:16:25.798785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.798765    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-99f4d967f-qmk2x"]
Jul 29 00:16:25.892864 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.892827    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:25.895885 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.895865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xf4c\" (UniqueName: \"kubernetes.io/projected/c78cd09f-f38f-4428-9ff3-3120354857fd-kube-api-access-5xf4c\") pod \"authorino-99f4d967f-qmk2x\" (UID: \"c78cd09f-f38f-4428-9ff3-3120354857fd\") " pod="kuadrant-system/authorino-99f4d967f-qmk2x"
Jul 29 00:16:25.899337 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.899319    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6sbkl"]
Jul 29 00:16:25.901525 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:16:25.901499    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11f07dcb_258d_4e2e_815e_b2bf6941ef91.slice/crio-089ea86c6c625b8bb0784f769227ec22fdc9d1825978935f60369b13a9850e65 WatchSource:0}: Error finding container 089ea86c6c625b8bb0784f769227ec22fdc9d1825978935f60369b13a9850e65: Status 404 returned error can't find the container with id 089ea86c6c625b8bb0784f769227ec22fdc9d1825978935f60369b13a9850e65
Jul 29 00:16:25.997155 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:25.997127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xf4c\" (UniqueName: \"kubernetes.io/projected/c78cd09f-f38f-4428-9ff3-3120354857fd-kube-api-access-5xf4c\") pod \"authorino-99f4d967f-qmk2x\" (UID: \"c78cd09f-f38f-4428-9ff3-3120354857fd\") " pod="kuadrant-system/authorino-99f4d967f-qmk2x"
Jul 29 00:16:26.005389 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.005361    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xf4c\" (UniqueName: \"kubernetes.io/projected/c78cd09f-f38f-4428-9ff3-3120354857fd-kube-api-access-5xf4c\") pod \"authorino-99f4d967f-qmk2x\" (UID: \"c78cd09f-f38f-4428-9ff3-3120354857fd\") " pod="kuadrant-system/authorino-99f4d967f-qmk2x"
Jul 29 00:16:26.102482 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.102423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-99f4d967f-qmk2x"
Jul 29 00:16:26.234847 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.234822    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-99f4d967f-qmk2x"]
Jul 29 00:16:26.236957 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:16:26.236930    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc78cd09f_f38f_4428_9ff3_3120354857fd.slice/crio-2d2da979903ba1ca6aafd66059c914ad9f368b90c0b5c6e09016231e40d0ebcc WatchSource:0}: Error finding container 2d2da979903ba1ca6aafd66059c914ad9f368b90c0b5c6e09016231e40d0ebcc: Status 404 returned error can't find the container with id 2d2da979903ba1ca6aafd66059c914ad9f368b90c0b5c6e09016231e40d0ebcc
Jul 29 00:16:26.365273 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.365212    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-99f4d967f-qmk2x"]
Jul 29 00:16:26.393371 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.393344    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d6896499-pd2vh"]
Jul 29 00:16:26.397785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.397761    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:16:26.400446 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.400424    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 00:16:26.404744 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.404726    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d6896499-pd2vh"]
Jul 29 00:16:26.454240 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.454217    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-99f4d967f-qmk2x" event={"ID":"c78cd09f-f38f-4428-9ff3-3120354857fd","Type":"ContainerStarted","Data":"2d2da979903ba1ca6aafd66059c914ad9f368b90c0b5c6e09016231e40d0ebcc"}
Jul 29 00:16:26.455580 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.455557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6sbkl" event={"ID":"11f07dcb-258d-4e2e-815e-b2bf6941ef91","Type":"ContainerStarted","Data":"089ea86c6c625b8bb0784f769227ec22fdc9d1825978935f60369b13a9850e65"}
Jul 29 00:16:26.499307 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.499285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr2sd\" (UniqueName: \"kubernetes.io/projected/136f21ed-c502-4ffd-a917-5a25fd5d6525-kube-api-access-xr2sd\") pod \"authorino-5d6896499-pd2vh\" (UID: \"136f21ed-c502-4ffd-a917-5a25fd5d6525\") " pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:16:26.499399 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.499316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/136f21ed-c502-4ffd-a917-5a25fd5d6525-tls-cert\") pod \"authorino-5d6896499-pd2vh\" (UID: \"136f21ed-c502-4ffd-a917-5a25fd5d6525\") " pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:16:26.600036 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.599999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr2sd\" (UniqueName: \"kubernetes.io/projected/136f21ed-c502-4ffd-a917-5a25fd5d6525-kube-api-access-xr2sd\") pod \"authorino-5d6896499-pd2vh\" (UID: \"136f21ed-c502-4ffd-a917-5a25fd5d6525\") " pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:16:26.600036 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.600038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/136f21ed-c502-4ffd-a917-5a25fd5d6525-tls-cert\") pod \"authorino-5d6896499-pd2vh\" (UID: \"136f21ed-c502-4ffd-a917-5a25fd5d6525\") " pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:16:26.602570 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.602549    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/136f21ed-c502-4ffd-a917-5a25fd5d6525-tls-cert\") pod \"authorino-5d6896499-pd2vh\" (UID: \"136f21ed-c502-4ffd-a917-5a25fd5d6525\") " pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:16:26.608849 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.608827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr2sd\" (UniqueName: \"kubernetes.io/projected/136f21ed-c502-4ffd-a917-5a25fd5d6525-kube-api-access-xr2sd\") pod \"authorino-5d6896499-pd2vh\" (UID: \"136f21ed-c502-4ffd-a917-5a25fd5d6525\") " pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:16:26.707765 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.707741    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:16:26.847445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:26.847415    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d6896499-pd2vh"]
Jul 29 00:16:26.848325 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:16:26.848287    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod136f21ed_c502_4ffd_a917_5a25fd5d6525.slice/crio-bf91272f5d00bf7faaeaa4094536979597588b3ad403470eaaebff0ea8cd2d30 WatchSource:0}: Error finding container bf91272f5d00bf7faaeaa4094536979597588b3ad403470eaaebff0ea8cd2d30: Status 404 returned error can't find the container with id bf91272f5d00bf7faaeaa4094536979597588b3ad403470eaaebff0ea8cd2d30
Jul 29 00:16:27.464412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.464377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d6896499-pd2vh" event={"ID":"136f21ed-c502-4ffd-a917-5a25fd5d6525","Type":"ContainerStarted","Data":"70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4"}
Jul 29 00:16:27.464412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.464427    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d6896499-pd2vh" event={"ID":"136f21ed-c502-4ffd-a917-5a25fd5d6525","Type":"ContainerStarted","Data":"bf91272f5d00bf7faaeaa4094536979597588b3ad403470eaaebff0ea8cd2d30"}
Jul 29 00:16:27.466374 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.466333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-99f4d967f-qmk2x" event={"ID":"c78cd09f-f38f-4428-9ff3-3120354857fd","Type":"ContainerStarted","Data":"3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d"}
Jul 29 00:16:27.466526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.466396    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-99f4d967f-qmk2x" podUID="c78cd09f-f38f-4428-9ff3-3120354857fd" containerName="authorino" containerID="cri-o://3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d" gracePeriod=30
Jul 29 00:16:27.469111 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.469067    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6sbkl" event={"ID":"11f07dcb-258d-4e2e-815e-b2bf6941ef91","Type":"ContainerStarted","Data":"b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608"}
Jul 29 00:16:27.469265 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.469239    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-6sbkl" podUID="11f07dcb-258d-4e2e-815e-b2bf6941ef91" containerName="authorino" containerID="cri-o://b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608" gracePeriod=30
Jul 29 00:16:27.480717 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.480641    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d6896499-pd2vh" podStartSLOduration=0.977033683 podStartE2EDuration="1.480626714s" totalImagesPullingTime="503.593031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:16:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:16:27.479572645 +0000 UTC m=+519.044025597" watchObservedRunningTime="2026-07-29 00:16:27.480626714 +0000 UTC m=+519.045079682"
Jul 29 00:16:27.511118 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.511058    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-99f4d967f-qmk2x" podStartSLOduration=2.049737964 podStartE2EDuration="2.511041013s" totalImagesPullingTime="461.303049ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:16:27.510385676 +0000 UTC m=+519.074838632" watchObservedRunningTime="2026-07-29 00:16:27.511041013 +0000 UTC m=+519.075493965"
Jul 29 00:16:27.511641 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.511613    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-6sbkl" podStartSLOduration=1.960275868 podStartE2EDuration="2.511605551s" totalImagesPullingTime="551.329683ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:16:27.493312939 +0000 UTC m=+519.057765893" watchObservedRunningTime="2026-07-29 00:16:27.511605551 +0000 UTC m=+519.076058504"
Jul 29 00:16:27.747767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.747728    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6sbkl"
Jul 29 00:16:27.751262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.751244    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-99f4d967f-qmk2x"
Jul 29 00:16:27.811093 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.811062    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xf4c\" (UniqueName: \"kubernetes.io/projected/c78cd09f-f38f-4428-9ff3-3120354857fd-kube-api-access-5xf4c\") pod \"c78cd09f-f38f-4428-9ff3-3120354857fd\" (UID: \"c78cd09f-f38f-4428-9ff3-3120354857fd\") "
Jul 29 00:16:27.811291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.811105    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p52st\" (UniqueName: \"kubernetes.io/projected/11f07dcb-258d-4e2e-815e-b2bf6941ef91-kube-api-access-p52st\") pod \"11f07dcb-258d-4e2e-815e-b2bf6941ef91\" (UID: \"11f07dcb-258d-4e2e-815e-b2bf6941ef91\") "
Jul 29 00:16:27.813338 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.813308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c78cd09f-f38f-4428-9ff3-3120354857fd-kube-api-access-5xf4c" (OuterVolumeSpecName: "kube-api-access-5xf4c") pod "c78cd09f-f38f-4428-9ff3-3120354857fd" (UID: "c78cd09f-f38f-4428-9ff3-3120354857fd"). InnerVolumeSpecName "kube-api-access-5xf4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:16:27.813437 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.813389    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f07dcb-258d-4e2e-815e-b2bf6941ef91-kube-api-access-p52st" (OuterVolumeSpecName: "kube-api-access-p52st") pod "11f07dcb-258d-4e2e-815e-b2bf6941ef91" (UID: "11f07dcb-258d-4e2e-815e-b2bf6941ef91"). InnerVolumeSpecName "kube-api-access-p52st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:16:27.912350 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.912269    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xf4c\" (UniqueName: \"kubernetes.io/projected/c78cd09f-f38f-4428-9ff3-3120354857fd-kube-api-access-5xf4c\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:16:27.912350 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:27.912309    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p52st\" (UniqueName: \"kubernetes.io/projected/11f07dcb-258d-4e2e-815e-b2bf6941ef91-kube-api-access-p52st\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:16:28.477266 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.477222    2559 generic.go:356] "Generic (PLEG): container finished" podID="c78cd09f-f38f-4428-9ff3-3120354857fd" containerID="3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d" exitCode=0
Jul 29 00:16:28.477740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.477295    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-99f4d967f-qmk2x"
Jul 29 00:16:28.477740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.477306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-99f4d967f-qmk2x" event={"ID":"c78cd09f-f38f-4428-9ff3-3120354857fd","Type":"ContainerDied","Data":"3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d"}
Jul 29 00:16:28.477740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.477353    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-99f4d967f-qmk2x" event={"ID":"c78cd09f-f38f-4428-9ff3-3120354857fd","Type":"ContainerDied","Data":"2d2da979903ba1ca6aafd66059c914ad9f368b90c0b5c6e09016231e40d0ebcc"}
Jul 29 00:16:28.477740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.477373    2559 scope.go:117] "RemoveContainer" containerID="3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d"
Jul 29 00:16:28.478809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.478658    2559 generic.go:356] "Generic (PLEG): container finished" podID="11f07dcb-258d-4e2e-815e-b2bf6941ef91" containerID="b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608" exitCode=0
Jul 29 00:16:28.478809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.478735    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6sbkl"
Jul 29 00:16:28.478809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.478773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6sbkl" event={"ID":"11f07dcb-258d-4e2e-815e-b2bf6941ef91","Type":"ContainerDied","Data":"b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608"}
Jul 29 00:16:28.478809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.478807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-6sbkl" event={"ID":"11f07dcb-258d-4e2e-815e-b2bf6941ef91","Type":"ContainerDied","Data":"089ea86c6c625b8bb0784f769227ec22fdc9d1825978935f60369b13a9850e65"}
Jul 29 00:16:28.488024 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.487997    2559 scope.go:117] "RemoveContainer" containerID="3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d"
Jul 29 00:16:28.488359 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:16:28.488336    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d\": container with ID starting with 3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d not found: ID does not exist" containerID="3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d"
Jul 29 00:16:28.488446 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.488364    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d"} err="failed to get container status \"3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d\": rpc error: code = NotFound desc = could not find container \"3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d\": container with ID starting with 3df18a84c5bd703b5415cf98b7150df7bc3756d8d5d45ca2f0903c845852027d not found: ID does not exist"
Jul 29 00:16:28.488446 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.488381    2559 scope.go:117] "RemoveContainer" containerID="b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608"
Jul 29 00:16:28.496355 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.496340    2559 scope.go:117] "RemoveContainer" containerID="b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608"
Jul 29 00:16:28.496588 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:16:28.496571    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608\": container with ID starting with b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608 not found: ID does not exist" containerID="b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608"
Jul 29 00:16:28.496658 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.496592    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608"} err="failed to get container status \"b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608\": rpc error: code = NotFound desc = could not find container \"b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608\": container with ID starting with b2b0c54d25698e693b41f971bb9957cbdade470e258f0fb18f50a8d5d3016608 not found: ID does not exist"
Jul 29 00:16:28.502563 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.502544    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6sbkl"]
Jul 29 00:16:28.508179 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.508159    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6sbkl"]
Jul 29 00:16:28.519078 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.519061    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-99f4d967f-qmk2x"]
Jul 29 00:16:28.521828 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:28.521810    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-99f4d967f-qmk2x"]
Jul 29 00:16:29.012059 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:29.012029    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f07dcb-258d-4e2e-815e-b2bf6941ef91" path="/var/lib/kubelet/pods/11f07dcb-258d-4e2e-815e-b2bf6941ef91/volumes"
Jul 29 00:16:29.012346 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:29.012333    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c78cd09f-f38f-4428-9ff3-3120354857fd" path="/var/lib/kubelet/pods/c78cd09f-f38f-4428-9ff3-3120354857fd/volumes"
Jul 29 00:16:32.188419 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:32.188390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:32.261040 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:32.261006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:32.378205 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:32.378170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:32.522539 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:32.522437    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:35.637893 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:35.637860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:16:35.735015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:16:35.734983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:08.072550 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:08.072513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:08.179708 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:08.179653    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:08.626344 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:08.626312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:08.907607 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:08.907502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:09.131695 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:09.131655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:09.233490 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:09.233408    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:10.417594 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:10.417552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:21.221490 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:21.221447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:21.326900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:21.326857    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:25.748752 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:25.748717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:39.419813 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:39.419773    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:42.356824 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:42.356786    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:48.887454 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:48.887427    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:17:48.891652 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:48.891629    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:17:48.898087 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:48.898067    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:17:48.901794 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:48.901780    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:17:54.010644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.010615    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"]
Jul 29 00:17:54.012933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.010972    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f07dcb-258d-4e2e-815e-b2bf6941ef91" containerName="authorino"
Jul 29 00:17:54.012933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.010984    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f07dcb-258d-4e2e-815e-b2bf6941ef91" containerName="authorino"
Jul 29 00:17:54.012933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.011004    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c78cd09f-f38f-4428-9ff3-3120354857fd" containerName="authorino"
Jul 29 00:17:54.012933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.011009    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c78cd09f-f38f-4428-9ff3-3120354857fd" containerName="authorino"
Jul 29 00:17:54.012933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.011064    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="11f07dcb-258d-4e2e-815e-b2bf6941ef91" containerName="authorino"
Jul 29 00:17:54.012933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.011074    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c78cd09f-f38f-4428-9ff3-3120354857fd" containerName="authorino"
Jul 29 00:17:54.019720 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.019701    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.023229 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.023203    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"]
Jul 29 00:17:54.024015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.023995    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 00:17:54.024243 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.023999    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gmvtm\""
Jul 29 00:17:54.024333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.024053    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 00:17:54.024333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.024055    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 00:17:54.055525 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.055490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:17:54.119402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.119371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.119576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.119414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdw95\" (UniqueName: \"kubernetes.io/projected/a5c031c0-dba3-481f-b444-946aee45618d-kube-api-access-kdw95\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.119576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.119464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.119576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.119508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.119576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.119557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.119576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.119575    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c031c0-dba3-481f-b444-946aee45618d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.220840 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.220804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdw95\" (UniqueName: \"kubernetes.io/projected/a5c031c0-dba3-481f-b444-946aee45618d-kube-api-access-kdw95\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.221038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.220845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.221038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.220887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.221038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.220930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.221038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.220955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c031c0-dba3-481f-b444-946aee45618d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.221038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.221022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.221324 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.221296    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.221374 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.221318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.221374 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.221351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.223319 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.223298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5c031c0-dba3-481f-b444-946aee45618d-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.223634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.223617    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5c031c0-dba3-481f-b444-946aee45618d-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.228612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.228589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdw95\" (UniqueName: \"kubernetes.io/projected/a5c031c0-dba3-481f-b444-946aee45618d-kube-api-access-kdw95\") pod \"e2e-trlp-test-simulated-kserve-598466548d-djf28\" (UID: \"a5c031c0-dba3-481f-b444-946aee45618d\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.331916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.331846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:17:54.465947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.465916    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"]
Jul 29 00:17:54.466873 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:17:54.466849    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c031c0_dba3_481f_b444_946aee45618d.slice/crio-118ad6c8ad89dcb31ed9b0cd9d75c67adbe5630666b8344e34bf92d858fba23d WatchSource:0}: Error finding container 118ad6c8ad89dcb31ed9b0cd9d75c67adbe5630666b8344e34bf92d858fba23d: Status 404 returned error can't find the container with id 118ad6c8ad89dcb31ed9b0cd9d75c67adbe5630666b8344e34bf92d858fba23d
Jul 29 00:17:54.468482 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.468467    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 00:17:54.877756 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:54.877714    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28" event={"ID":"a5c031c0-dba3-481f-b444-946aee45618d","Type":"ContainerStarted","Data":"118ad6c8ad89dcb31ed9b0cd9d75c67adbe5630666b8344e34bf92d858fba23d"}
Jul 29 00:17:55.884345 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:55.884308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28" event={"ID":"a5c031c0-dba3-481f-b444-946aee45618d","Type":"ContainerStarted","Data":"625a625618b8dafec6622f47738f54d200c1e33995aa69c5369c3801923e1588"}
Jul 29 00:17:55.906879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:17:55.906825    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28" podStartSLOduration=1.907846779 podStartE2EDuration="2.90681012s" totalImagesPullingTime="998.963341ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:17:55.904949348 +0000 UTC m=+607.469402300" watchObservedRunningTime="2026-07-29 00:17:55.90681012 +0000 UTC m=+607.471263071"
Jul 29 00:18:04.332953 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:04.332913    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:18:04.333343 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:04.332982    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:18:04.345465 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:04.345446    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:18:04.646008 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:04.645973    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:18:04.939203 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:04.939112    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-djf28"
Jul 29 00:18:22.336026 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:22.335991    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:18:30.203005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.202660    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"]
Jul 29 00:18:30.206421 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.206400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.209249 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.209217    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 29 00:18:30.217560 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.217533    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"]
Jul 29 00:18:30.235965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.235941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:18:30.346277 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.346243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktw58\" (UniqueName: \"kubernetes.io/projected/782d8340-d0da-4add-b971-4632fbc85a7d-kube-api-access-ktw58\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.346440 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.346285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.346440 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.346399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/782d8340-d0da-4add-b971-4632fbc85a7d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.346440 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.346429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.346566 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.346449    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.346566 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.346475    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.447468 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.447433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.447634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.447527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/782d8340-d0da-4add-b971-4632fbc85a7d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.447634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.447548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.447634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.447564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.447634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.447580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.447634 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.447620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktw58\" (UniqueName: \"kubernetes.io/projected/782d8340-d0da-4add-b971-4632fbc85a7d-kube-api-access-ktw58\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.447941 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.447908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.448003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.447926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.448058 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.448014    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.449947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.449921    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/782d8340-d0da-4add-b971-4632fbc85a7d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.450108 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.450090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/782d8340-d0da-4add-b971-4632fbc85a7d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.455281 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.455231    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktw58\" (UniqueName: \"kubernetes.io/projected/782d8340-d0da-4add-b971-4632fbc85a7d-kube-api-access-ktw58\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-pssvs\" (UID: \"782d8340-d0da-4add-b971-4632fbc85a7d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.517673 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.517646    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:30.652408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:30.652385    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"]
Jul 29 00:18:30.654474 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:18:30.654448    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod782d8340_d0da_4add_b971_4632fbc85a7d.slice/crio-959446609aac9ec078d387d9b7cc0867806b1722013ff42610d09c5a4de16aa0 WatchSource:0}: Error finding container 959446609aac9ec078d387d9b7cc0867806b1722013ff42610d09c5a4de16aa0: Status 404 returned error can't find the container with id 959446609aac9ec078d387d9b7cc0867806b1722013ff42610d09c5a4de16aa0
Jul 29 00:18:31.058132 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:31.058098    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs" event={"ID":"782d8340-d0da-4add-b971-4632fbc85a7d","Type":"ContainerStarted","Data":"e40204c6f6e4f03569ca332e4a3d9b0b3f87ebea2b9b6c74060a33be624b32de"}
Jul 29 00:18:31.058316 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:31.058141    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs" event={"ID":"782d8340-d0da-4add-b971-4632fbc85a7d","Type":"ContainerStarted","Data":"959446609aac9ec078d387d9b7cc0867806b1722013ff42610d09c5a4de16aa0"}
Jul 29 00:18:31.079621 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:31.079572    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs" podStartSLOduration=0.901962601 podStartE2EDuration="1.079558504s" totalImagesPullingTime="177.595903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:18:31.077058666 +0000 UTC m=+642.641511618" watchObservedRunningTime="2026-07-29 00:18:31.079558504 +0000 UTC m=+642.644011456"
Jul 29 00:18:32.166938 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:32.166898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:18:40.517990 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:40.517952    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:40.518378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:40.518036    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:40.530566 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:40.530548    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:18:41.117645 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:18:41.117617    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-pssvs"
Jul 29 00:19:35.197518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:35.197472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:19:39.659219 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:39.659178    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:19:39.758089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:39.758046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:19:40.691039 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.691004    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d6896499-pd2vh"]
Jul 29 00:19:40.691441 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.691258    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d6896499-pd2vh" podUID="136f21ed-c502-4ffd-a917-5a25fd5d6525" containerName="authorino" containerID="cri-o://70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4" gracePeriod=30
Jul 29 00:19:40.834392 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.834359    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:19:40.922623 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.922591    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:19:40.953034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.952980    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:19:40.966250 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.966224    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr2sd\" (UniqueName: \"kubernetes.io/projected/136f21ed-c502-4ffd-a917-5a25fd5d6525-kube-api-access-xr2sd\") pod \"136f21ed-c502-4ffd-a917-5a25fd5d6525\" (UID: \"136f21ed-c502-4ffd-a917-5a25fd5d6525\") "
Jul 29 00:19:40.966384 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.966306    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/136f21ed-c502-4ffd-a917-5a25fd5d6525-tls-cert\") pod \"136f21ed-c502-4ffd-a917-5a25fd5d6525\" (UID: \"136f21ed-c502-4ffd-a917-5a25fd5d6525\") "
Jul 29 00:19:40.968527 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.968500    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136f21ed-c502-4ffd-a917-5a25fd5d6525-kube-api-access-xr2sd" (OuterVolumeSpecName: "kube-api-access-xr2sd") pod "136f21ed-c502-4ffd-a917-5a25fd5d6525" (UID: "136f21ed-c502-4ffd-a917-5a25fd5d6525"). InnerVolumeSpecName "kube-api-access-xr2sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:19:40.978950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:40.978913    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136f21ed-c502-4ffd-a917-5a25fd5d6525-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "136f21ed-c502-4ffd-a917-5a25fd5d6525" (UID: "136f21ed-c502-4ffd-a917-5a25fd5d6525"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:19:41.066933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.066895    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr2sd\" (UniqueName: \"kubernetes.io/projected/136f21ed-c502-4ffd-a917-5a25fd5d6525-kube-api-access-xr2sd\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:19:41.066933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.066919    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/136f21ed-c502-4ffd-a917-5a25fd5d6525-tls-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:19:41.394979 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.394942    2559 generic.go:356] "Generic (PLEG): container finished" podID="136f21ed-c502-4ffd-a917-5a25fd5d6525" containerID="70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4" exitCode=0
Jul 29 00:19:41.394979 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.394982    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d6896499-pd2vh"
Jul 29 00:19:41.395208 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.394980    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d6896499-pd2vh" event={"ID":"136f21ed-c502-4ffd-a917-5a25fd5d6525","Type":"ContainerDied","Data":"70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4"}
Jul 29 00:19:41.395208 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.395023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d6896499-pd2vh" event={"ID":"136f21ed-c502-4ffd-a917-5a25fd5d6525","Type":"ContainerDied","Data":"bf91272f5d00bf7faaeaa4094536979597588b3ad403470eaaebff0ea8cd2d30"}
Jul 29 00:19:41.395208 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.395040    2559 scope.go:117] "RemoveContainer" containerID="70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4"
Jul 29 00:19:41.403795 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.403778    2559 scope.go:117] "RemoveContainer" containerID="70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4"
Jul 29 00:19:41.404067 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:19:41.404044    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4\": container with ID starting with 70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4 not found: ID does not exist" containerID="70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4"
Jul 29 00:19:41.404176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.404075    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4"} err="failed to get container status \"70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4\": rpc error: code = NotFound desc = could not find container \"70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4\": container with ID starting with 70f9214731406fb983cb5067fc3835c888077a69762c56a536dd075fe2def8b4 not found: ID does not exist"
Jul 29 00:19:41.417511 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.417487    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d6896499-pd2vh"]
Jul 29 00:19:41.423030 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:41.423007    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d6896499-pd2vh"]
Jul 29 00:19:43.010439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:19:43.010409    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136f21ed-c502-4ffd-a917-5a25fd5d6525" path="/var/lib/kubelet/pods/136f21ed-c502-4ffd-a917-5a25fd5d6525/volumes"
Jul 29 00:20:16.624566 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:20:16.624527    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:20:16.724077 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:20:16.724045    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:21:44.951796 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:21:44.951756    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:21:46.927033 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:21:46.926990    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:21:48.105777 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:21:48.105739    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:13.748979 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:13.748941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:29.784505 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:29.784469    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:29.876987 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:29.876955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:29.983926 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:29.983894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:35.542409 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:35.542375    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:35.602541 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:35.602507    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:35.704061 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:35.704025    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:35.803282 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:35.803210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:35.919891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:35.919861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:41.664281 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:41.664153    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:41.722989 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:41.722962    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:22:48.920548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:48.920518    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:22:48.924429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:48.924405    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:22:48.927278 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:48.927259    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:22:48.931006 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:22:48.930986    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:23:02.371066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:23:02.371022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:26:57.534536 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:26:57.534502    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"]
Jul 29 00:26:57.535163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:26:57.534733    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s" podUID="10d1813e-c27c-4916-b7aa-d49fda3d964a" containerName="manager" containerID="cri-o://f77093729ee9a54f4726867496f36764936928da0031e58b447697c01b35203a" gracePeriod=10
Jul 29 00:27:00.142979 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.142931    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s" podUID="10d1813e-c27c-4916-b7aa-d49fda3d964a" containerName="manager" probeResult="failure" output="Get \"http://10.132.0.40:8081/readyz\": dial tcp 10.132.0.40:8081: connect: connection refused"
Jul 29 00:27:00.502723 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.502693    2559 generic.go:356] "Generic (PLEG): container finished" podID="10d1813e-c27c-4916-b7aa-d49fda3d964a" containerID="f77093729ee9a54f4726867496f36764936928da0031e58b447697c01b35203a" exitCode=0
Jul 29 00:27:00.502870 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.502775    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s" event={"ID":"10d1813e-c27c-4916-b7aa-d49fda3d964a","Type":"ContainerDied","Data":"f77093729ee9a54f4726867496f36764936928da0031e58b447697c01b35203a"}
Jul 29 00:27:00.593122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.593101    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:27:00.714431 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.714348    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10d1813e-c27c-4916-b7aa-d49fda3d964a-extensions-socket-volume\") pod \"10d1813e-c27c-4916-b7aa-d49fda3d964a\" (UID: \"10d1813e-c27c-4916-b7aa-d49fda3d964a\") "
Jul 29 00:27:00.714431 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.714396    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbl7r\" (UniqueName: \"kubernetes.io/projected/10d1813e-c27c-4916-b7aa-d49fda3d964a-kube-api-access-sbl7r\") pod \"10d1813e-c27c-4916-b7aa-d49fda3d964a\" (UID: \"10d1813e-c27c-4916-b7aa-d49fda3d964a\") "
Jul 29 00:27:00.714719 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.714697    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d1813e-c27c-4916-b7aa-d49fda3d964a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "10d1813e-c27c-4916-b7aa-d49fda3d964a" (UID: "10d1813e-c27c-4916-b7aa-d49fda3d964a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:27:00.716485 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.716461    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d1813e-c27c-4916-b7aa-d49fda3d964a-kube-api-access-sbl7r" (OuterVolumeSpecName: "kube-api-access-sbl7r") pod "10d1813e-c27c-4916-b7aa-d49fda3d964a" (UID: "10d1813e-c27c-4916-b7aa-d49fda3d964a"). InnerVolumeSpecName "kube-api-access-sbl7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:27:00.815142 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.815118    2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10d1813e-c27c-4916-b7aa-d49fda3d964a-extensions-socket-volume\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:27:00.815142 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:00.815139    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbl7r\" (UniqueName: \"kubernetes.io/projected/10d1813e-c27c-4916-b7aa-d49fda3d964a-kube-api-access-sbl7r\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:27:01.510063 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:01.510036    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"
Jul 29 00:27:01.510063 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:01.510046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s" event={"ID":"10d1813e-c27c-4916-b7aa-d49fda3d964a","Type":"ContainerDied","Data":"552cc0c9e1e566419cbcb4e445796ac627f26c7c867e3bde0237bc4cc537ccdb"}
Jul 29 00:27:01.510559 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:01.510101    2559 scope.go:117] "RemoveContainer" containerID="f77093729ee9a54f4726867496f36764936928da0031e58b447697c01b35203a"
Jul 29 00:27:01.527008 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:01.526983    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"]
Jul 29 00:27:01.530531 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:01.530507    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pt87s"]
Jul 29 00:27:03.010754 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:03.010719    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d1813e-c27c-4916-b7aa-d49fda3d964a" path="/var/lib/kubelet/pods/10d1813e-c27c-4916-b7aa-d49fda3d964a/volumes"
Jul 29 00:27:05.554406 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:05.554370    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:27:48.952776 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:48.952742    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:27:48.955190 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:48.955170    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:27:48.958422 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:48.958391    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:27:48.961630 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:48.961588    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:27:58.678521 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.678486    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"]
Jul 29 00:27:58.679003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.678834    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136f21ed-c502-4ffd-a917-5a25fd5d6525" containerName="authorino"
Jul 29 00:27:58.679003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.678845    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="136f21ed-c502-4ffd-a917-5a25fd5d6525" containerName="authorino"
Jul 29 00:27:58.679003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.678871    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d1813e-c27c-4916-b7aa-d49fda3d964a" containerName="manager"
Jul 29 00:27:58.679003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.678876    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d1813e-c27c-4916-b7aa-d49fda3d964a" containerName="manager"
Jul 29 00:27:58.679003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.678932    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d1813e-c27c-4916-b7aa-d49fda3d964a" containerName="manager"
Jul 29 00:27:58.679003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.678944    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="136f21ed-c502-4ffd-a917-5a25fd5d6525" containerName="authorino"
Jul 29 00:27:58.683027 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.683008    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:58.686009 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.685990    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-psdv4\""
Jul 29 00:27:58.693832 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.693802    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"]
Jul 29 00:27:58.699459 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.699433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af4f9e6b-1e24-4110-96ad-6d679734d138-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fzp92\" (UID: \"af4f9e6b-1e24-4110-96ad-6d679734d138\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:58.699577 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.699491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfv9h\" (UniqueName: \"kubernetes.io/projected/af4f9e6b-1e24-4110-96ad-6d679734d138-kube-api-access-bfv9h\") pod \"kuadrant-operator-controller-manager-86878c769f-fzp92\" (UID: \"af4f9e6b-1e24-4110-96ad-6d679734d138\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:58.800511 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.800480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfv9h\" (UniqueName: \"kubernetes.io/projected/af4f9e6b-1e24-4110-96ad-6d679734d138-kube-api-access-bfv9h\") pod \"kuadrant-operator-controller-manager-86878c769f-fzp92\" (UID: \"af4f9e6b-1e24-4110-96ad-6d679734d138\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:58.800692 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.800538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af4f9e6b-1e24-4110-96ad-6d679734d138-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fzp92\" (UID: \"af4f9e6b-1e24-4110-96ad-6d679734d138\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:58.800917 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.800900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/af4f9e6b-1e24-4110-96ad-6d679734d138-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fzp92\" (UID: \"af4f9e6b-1e24-4110-96ad-6d679734d138\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:58.809864 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.809848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfv9h\" (UniqueName: \"kubernetes.io/projected/af4f9e6b-1e24-4110-96ad-6d679734d138-kube-api-access-bfv9h\") pod \"kuadrant-operator-controller-manager-86878c769f-fzp92\" (UID: \"af4f9e6b-1e24-4110-96ad-6d679734d138\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:58.995045 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:58.994954    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:59.136600 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:59.136577    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"]
Jul 29 00:27:59.139049 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:27:59.139024    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4f9e6b_1e24_4110_96ad_6d679734d138.slice/crio-2694e2e4b0dabc309e6cf439f2a063b7af35fb9134a9a2fa77cc158a977b5b9f WatchSource:0}: Error finding container 2694e2e4b0dabc309e6cf439f2a063b7af35fb9134a9a2fa77cc158a977b5b9f: Status 404 returned error can't find the container with id 2694e2e4b0dabc309e6cf439f2a063b7af35fb9134a9a2fa77cc158a977b5b9f
Jul 29 00:27:59.783309 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:59.783272    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92" event={"ID":"af4f9e6b-1e24-4110-96ad-6d679734d138","Type":"ContainerStarted","Data":"f611eb0dbff33a098dcd7217fdebd76c095c844729fb6ed819bf3c03c6f92098"}
Jul 29 00:27:59.783751 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:59.783326    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92" event={"ID":"af4f9e6b-1e24-4110-96ad-6d679734d138","Type":"ContainerStarted","Data":"2694e2e4b0dabc309e6cf439f2a063b7af35fb9134a9a2fa77cc158a977b5b9f"}
Jul 29 00:27:59.783751 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:59.783408    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:27:59.823112 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:27:59.823059    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92" podStartSLOduration=1.8230446740000001 podStartE2EDuration="1.823044674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:27:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:27:59.820344024 +0000 UTC m=+1211.384796976" watchObservedRunningTime="2026-07-29 00:27:59.823044674 +0000 UTC m=+1211.387497626"
Jul 29 00:28:10.790263 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:28:10.790166    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fzp92"
Jul 29 00:28:29.615195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:28:29.615159    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:30:00.145734 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:00.145694    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf"]
Jul 29 00:30:00.149145 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:00.149127    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf"
Jul 29 00:30:00.151924 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:00.151895    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:30:00.158977 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:00.158959    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf"
Jul 29 00:30:00.163747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:00.163717    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf"]
Jul 29 00:30:00.301753 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:00.301720    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf"]
Jul 29 00:30:00.304912 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:30:00.304888    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe44157_f120_4a2a_959f_406de45d7d66.slice/crio-67be8f65145db98f233885694b49f1988bdb4b653b1bf0714ad2b6ea57ca781c WatchSource:0}: Error finding container 67be8f65145db98f233885694b49f1988bdb4b653b1bf0714ad2b6ea57ca781c: Status 404 returned error can't find the container with id 67be8f65145db98f233885694b49f1988bdb4b653b1bf0714ad2b6ea57ca781c
Jul 29 00:30:00.307110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:00.307094    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 00:30:00.361236 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:00.361197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf" event={"ID":"9fe44157-f120-4a2a-959f-406de45d7d66","Type":"ContainerStarted","Data":"67be8f65145db98f233885694b49f1988bdb4b653b1bf0714ad2b6ea57ca781c"}
Jul 29 00:30:04.384379 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:04.384338    2559 generic.go:356] "Generic (PLEG): container finished" podID="9fe44157-f120-4a2a-959f-406de45d7d66" containerID="04929ff1bccd275225b1692f85e5f59f881c881a0c51c2c1f35c75af027e8da7" exitCode=0
Jul 29 00:30:04.384779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:04.384428    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf" event={"ID":"9fe44157-f120-4a2a-959f-406de45d7d66","Type":"ContainerDied","Data":"04929ff1bccd275225b1692f85e5f59f881c881a0c51c2c1f35c75af027e8da7"}
Jul 29 00:30:05.524209 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:05.524185    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf"
Jul 29 00:30:06.396081 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:06.396054    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf"
Jul 29 00:30:06.396256 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:06.396047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754750-dggqf" event={"ID":"9fe44157-f120-4a2a-959f-406de45d7d66","Type":"ContainerDied","Data":"67be8f65145db98f233885694b49f1988bdb4b653b1bf0714ad2b6ea57ca781c"}
Jul 29 00:30:06.396256 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:06.396181    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67be8f65145db98f233885694b49f1988bdb4b653b1bf0714ad2b6ea57ca781c"
Jul 29 00:30:59.505947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.505907    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"]
Jul 29 00:30:59.506533 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.506449    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fe44157-f120-4a2a-959f-406de45d7d66" containerName="cleanup"
Jul 29 00:30:59.506533 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.506469    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fe44157-f120-4a2a-959f-406de45d7d66" containerName="cleanup"
Jul 29 00:30:59.506650 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.506567    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fe44157-f120-4a2a-959f-406de45d7d66" containerName="cleanup"
Jul 29 00:30:59.509316 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.509293    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.512707 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.512658    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-d6fc5285-kserve-self-signed-certs\""
Jul 29 00:30:59.519579 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.519557    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"]
Jul 29 00:30:59.563556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.563519    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-tmp-dir\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.563556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.563555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ea7cc62-76ac-486c-93ee-042fea6ec397-tls-certs\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.563767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.563612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-model-cache\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.563767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.563642    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xz4g\" (UniqueName: \"kubernetes.io/projected/8ea7cc62-76ac-486c-93ee-042fea6ec397-kube-api-access-7xz4g\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.563767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.563730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-home\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.563767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.563756    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-dshm\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.567609 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.567578    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:30:59.664940 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.664908    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-model-cache\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.665143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.664955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xz4g\" (UniqueName: \"kubernetes.io/projected/8ea7cc62-76ac-486c-93ee-042fea6ec397-kube-api-access-7xz4g\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.665143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.664986    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-home\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.665143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.665012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-dshm\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.665143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.665070    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-tmp-dir\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.665143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.665093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ea7cc62-76ac-486c-93ee-042fea6ec397-tls-certs\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.665411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.665384    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-model-cache\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.665468 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.665409    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-home\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.665662 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.665632    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-tmp-dir\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.667716 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.667694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-dshm\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.667837 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.667796    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ea7cc62-76ac-486c-93ee-042fea6ec397-tls-certs\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.673625 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.673605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xz4g\" (UniqueName: \"kubernetes.io/projected/8ea7cc62-76ac-486c-93ee-042fea6ec397-kube-api-access-7xz4g\") pod \"e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") " pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.819268 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.819186    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:30:59.952761 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:30:59.952738    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"]
Jul 29 00:30:59.954386 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:30:59.954349    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ea7cc62_76ac_486c_93ee_042fea6ec397.slice/crio-475a94d5c39569f976c38cd9b05f174e2695e1361909d84a657d9923b10f297a WatchSource:0}: Error finding container 475a94d5c39569f976c38cd9b05f174e2695e1361909d84a657d9923b10f297a: Status 404 returned error can't find the container with id 475a94d5c39569f976c38cd9b05f174e2695e1361909d84a657d9923b10f297a
Jul 29 00:31:00.668891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:00.668852    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x" event={"ID":"8ea7cc62-76ac-486c-93ee-042fea6ec397","Type":"ContainerStarted","Data":"d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915"}
Jul 29 00:31:00.669283 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:00.668903    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x" event={"ID":"8ea7cc62-76ac-486c-93ee-042fea6ec397","Type":"ContainerStarted","Data":"475a94d5c39569f976c38cd9b05f174e2695e1361909d84a657d9923b10f297a"}
Jul 29 00:31:00.686695 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:00.686635    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x" podStartSLOduration=1.6866198 podStartE2EDuration="1.6866198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:31:00.685499232 +0000 UTC m=+1392.249952185" watchObservedRunningTime="2026-07-29 00:31:00.6866198 +0000 UTC m=+1392.251072751"
Jul 29 00:31:08.906531 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:08.906487    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"]
Jul 29 00:31:08.910264 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:08.910241    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:08.913006 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:08.912984    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-d6fc5285-kserve-self-signed-certs\""
Jul 29 00:31:08.920952 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:08.920932    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"]
Jul 29 00:31:08.937815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:08.937788    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:31:09.048409 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.048377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tls-certs\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.048601 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.048421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tmp-dir\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.048601 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.048480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqzfz\" (UniqueName: \"kubernetes.io/projected/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-kube-api-access-rqzfz\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.048601 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.048502    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-dshm\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.048810 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.048607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-home\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.048810 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.048712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-model-cache\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.149870 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.149824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqzfz\" (UniqueName: \"kubernetes.io/projected/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-kube-api-access-rqzfz\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.149870 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.149884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-dshm\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.150222 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.149942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-home\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.150222 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.150129    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-model-cache\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.150222 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.150199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tls-certs\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.150386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.150257    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tmp-dir\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.150445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.150388    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-home\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.150445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.150426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-model-cache\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.150612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.150585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tmp-dir\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.152354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.152333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-dshm\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.152658 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.152638    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tls-certs\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.158224 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.158171    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqzfz\" (UniqueName: \"kubernetes.io/projected/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-kube-api-access-rqzfz\") pod \"e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") " pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.221373 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.221333    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:09.365569 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.365515    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"]
Jul 29 00:31:09.719165 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.719073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn" event={"ID":"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db","Type":"ContainerStarted","Data":"30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9"}
Jul 29 00:31:09.719165 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.719116    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn" event={"ID":"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db","Type":"ContainerStarted","Data":"e2b28c65af891047e576600d7791b5c7c552756dc52a207278df52253c491acc"}
Jul 29 00:31:09.737104 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.737062    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn" podStartSLOduration=1.7370496229999999 podStartE2EDuration="1.737049623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:31:09.736478995 +0000 UTC m=+1401.300931948" watchObservedRunningTime="2026-07-29 00:31:09.737049623 +0000 UTC m=+1401.301502574"
Jul 29 00:31:09.820051 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.820017    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:31:09.820193 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.820066    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:31:09.832647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:09.832621    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:31:10.735377 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:10.735348    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:31:19.221736 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:19.221706    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:19.221736 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:19.221744    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:19.234245 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:19.234218    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:19.779526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:19.779498    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:31:21.507617 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:21.507568    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:31:56.570364 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:56.570278    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"]
Jul 29 00:31:56.595975 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:56.595944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:31:57.523701 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:57.523653    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"]
Jul 29 00:31:57.556357 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:31:57.556317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:32:11.589881 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.589815    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x" podUID="8ea7cc62-76ac-486c-93ee-042fea6ec397" containerName="main" containerID="cri-o://d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915" gracePeriod=45
Jul 29 00:32:11.850644 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.850585    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:32:11.997103 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997071    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-home\") pod \"8ea7cc62-76ac-486c-93ee-042fea6ec397\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") "
Jul 29 00:32:11.997286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997137    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-tmp-dir\") pod \"8ea7cc62-76ac-486c-93ee-042fea6ec397\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") "
Jul 29 00:32:11.997286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997161    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-dshm\") pod \"8ea7cc62-76ac-486c-93ee-042fea6ec397\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") "
Jul 29 00:32:11.997286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997185    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ea7cc62-76ac-486c-93ee-042fea6ec397-tls-certs\") pod \"8ea7cc62-76ac-486c-93ee-042fea6ec397\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") "
Jul 29 00:32:11.997286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997228    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xz4g\" (UniqueName: \"kubernetes.io/projected/8ea7cc62-76ac-486c-93ee-042fea6ec397-kube-api-access-7xz4g\") pod \"8ea7cc62-76ac-486c-93ee-042fea6ec397\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") "
Jul 29 00:32:11.997505 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997317    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-model-cache\") pod \"8ea7cc62-76ac-486c-93ee-042fea6ec397\" (UID: \"8ea7cc62-76ac-486c-93ee-042fea6ec397\") "
Jul 29 00:32:11.997569 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997314    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-home" (OuterVolumeSpecName: "home") pod "8ea7cc62-76ac-486c-93ee-042fea6ec397" (UID: "8ea7cc62-76ac-486c-93ee-042fea6ec397"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:32:11.997569 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997424    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ea7cc62-76ac-486c-93ee-042fea6ec397" (UID: "8ea7cc62-76ac-486c-93ee-042fea6ec397"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:32:11.997712 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997597    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ea7cc62-76ac-486c-93ee-042fea6ec397" (UID: "8ea7cc62-76ac-486c-93ee-042fea6ec397"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:32:11.997777 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997735    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:11.997777 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997775    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:11.997883 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.997785    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:11.999547 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.999522    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ea7cc62-76ac-486c-93ee-042fea6ec397-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ea7cc62-76ac-486c-93ee-042fea6ec397" (UID: "8ea7cc62-76ac-486c-93ee-042fea6ec397"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:32:11.999547 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.999522    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-dshm" (OuterVolumeSpecName: "dshm") pod "8ea7cc62-76ac-486c-93ee-042fea6ec397" (UID: "8ea7cc62-76ac-486c-93ee-042fea6ec397"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:32:11.999693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:11.999606    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ea7cc62-76ac-486c-93ee-042fea6ec397-kube-api-access-7xz4g" (OuterVolumeSpecName: "kube-api-access-7xz4g") pod "8ea7cc62-76ac-486c-93ee-042fea6ec397" (UID: "8ea7cc62-76ac-486c-93ee-042fea6ec397"). InnerVolumeSpecName "kube-api-access-7xz4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:32:12.024878 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.024856    2559 generic.go:356] "Generic (PLEG): container finished" podID="8ea7cc62-76ac-486c-93ee-042fea6ec397" containerID="d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915" exitCode=0
Jul 29 00:32:12.024971 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.024892    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"
Jul 29 00:32:12.024971 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.024923    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x" event={"ID":"8ea7cc62-76ac-486c-93ee-042fea6ec397","Type":"ContainerDied","Data":"d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915"}
Jul 29 00:32:12.024971 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.024954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x" event={"ID":"8ea7cc62-76ac-486c-93ee-042fea6ec397","Type":"ContainerDied","Data":"475a94d5c39569f976c38cd9b05f174e2695e1361909d84a657d9923b10f297a"}
Jul 29 00:32:12.025079 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.024977    2559 scope.go:117] "RemoveContainer" containerID="d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915"
Jul 29 00:32:12.033943 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.033926    2559 scope.go:117] "RemoveContainer" containerID="d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915"
Jul 29 00:32:12.034227 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:32:12.034210    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915\": container with ID starting with d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915 not found: ID does not exist" containerID="d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915"
Jul 29 00:32:12.034277 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.034235    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915"} err="failed to get container status \"d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915\": rpc error: code = NotFound desc = could not find container \"d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915\": container with ID starting with d40c16e774a952f52f95865d935e741f95f0723f38630eef2f3fe1ad4d6b1915 not found: ID does not exist"
Jul 29 00:32:12.047911 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.047889    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"]
Jul 29 00:32:12.054171 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.054152    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-d6fc5285-kserve-74ff764d75-gzb6x"]
Jul 29 00:32:12.098549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.098527    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ea7cc62-76ac-486c-93ee-042fea6ec397-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:12.098549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.098549    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ea7cc62-76ac-486c-93ee-042fea6ec397-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:12.098744 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.098561    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xz4g\" (UniqueName: \"kubernetes.io/projected/8ea7cc62-76ac-486c-93ee-042fea6ec397-kube-api-access-7xz4g\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:12.542780 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.542738    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn" podUID="42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" containerName="main" containerID="cri-o://30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9" gracePeriod=45
Jul 29 00:32:12.797702 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.797622    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:32:12.905798 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.905771    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tmp-dir\") pod \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") "
Jul 29 00:32:12.905970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.905810    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-dshm\") pod \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") "
Jul 29 00:32:12.905970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.905840    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-model-cache\") pod \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") "
Jul 29 00:32:12.905970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.905872    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tls-certs\") pod \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") "
Jul 29 00:32:12.905970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.905956    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqzfz\" (UniqueName: \"kubernetes.io/projected/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-kube-api-access-rqzfz\") pod \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") "
Jul 29 00:32:12.906184 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.905997    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-home\") pod \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\" (UID: \"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db\") "
Jul 29 00:32:12.906184 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.906063    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" (UID: "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:32:12.906184 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.906110    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-model-cache" (OuterVolumeSpecName: "model-cache") pod "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" (UID: "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:32:12.906378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.906222    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-home" (OuterVolumeSpecName: "home") pod "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" (UID: "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:32:12.906378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.906316    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:12.906378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.906332    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:12.906378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.906347    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:12.908164 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.908141    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-dshm" (OuterVolumeSpecName: "dshm") pod "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" (UID: "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:32:12.908164 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.908147    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-kube-api-access-rqzfz" (OuterVolumeSpecName: "kube-api-access-rqzfz") pod "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" (UID: "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db"). InnerVolumeSpecName "kube-api-access-rqzfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:32:12.908304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:12.908165    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" (UID: "42da4e2c-d1e8-457a-80c2-6c07cb3bf9db"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:32:13.007769 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.007740    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqzfz\" (UniqueName: \"kubernetes.io/projected/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-kube-api-access-rqzfz\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:13.007769 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.007762    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:13.007769 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.007774    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:32:13.011348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.011323    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ea7cc62-76ac-486c-93ee-042fea6ec397" path="/var/lib/kubelet/pods/8ea7cc62-76ac-486c-93ee-042fea6ec397/volumes"
Jul 29 00:32:13.030871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.030849    2559 generic.go:356] "Generic (PLEG): container finished" podID="42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" containerID="30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9" exitCode=0
Jul 29 00:32:13.030965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.030884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn" event={"ID":"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db","Type":"ContainerDied","Data":"30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9"}
Jul 29 00:32:13.030965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.030891    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"
Jul 29 00:32:13.030965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.030907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn" event={"ID":"42da4e2c-d1e8-457a-80c2-6c07cb3bf9db","Type":"ContainerDied","Data":"e2b28c65af891047e576600d7791b5c7c552756dc52a207278df52253c491acc"}
Jul 29 00:32:13.030965 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.030922    2559 scope.go:117] "RemoveContainer" containerID="30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9"
Jul 29 00:32:13.039488 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.039466    2559 scope.go:117] "RemoveContainer" containerID="30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9"
Jul 29 00:32:13.039752 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:32:13.039731    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9\": container with ID starting with 30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9 not found: ID does not exist" containerID="30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9"
Jul 29 00:32:13.039830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.039759    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9"} err="failed to get container status \"30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9\": rpc error: code = NotFound desc = could not find container \"30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9\": container with ID starting with 30b961e458059950771655fe5671ce5bee47d3e23b179cf059a39c6b64648cd9 not found: ID does not exist"
Jul 29 00:32:13.052501 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.052450    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"]
Jul 29 00:32:13.063403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:13.063380    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-d6fc5285-kserve-6544999679-xf6qn"]
Jul 29 00:32:15.011294 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:15.011259    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" path="/var/lib/kubelet/pods/42da4e2c-d1e8-457a-80c2-6c07cb3bf9db/volumes"
Jul 29 00:32:19.794001 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:19.793972    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:32:21.212175 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:21.212137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:32:33.839333 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:33.839290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:32:48.986788 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:48.986761    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:32:48.987339 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:48.987164    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:32:48.990879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:48.990856    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:32:48.991378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:48.991350    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:32:55.436863 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:32:55.436829    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:33:32.970056 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:33:32.970024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:12.378399 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:12.378319    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:34.028127 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:34.028084    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:37.251254 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:37.251220    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:37.371487 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:37.371452    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:37.740682 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:37.740647    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:44.217960 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.217923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:44.428967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.428910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:44.558173 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.558081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:44.866451 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.866425    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"]
Jul 29 00:35:44.866841 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.866827    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ea7cc62-76ac-486c-93ee-042fea6ec397" containerName="main"
Jul 29 00:35:44.866894 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.866842    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ea7cc62-76ac-486c-93ee-042fea6ec397" containerName="main"
Jul 29 00:35:44.866894 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.866855    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" containerName="main"
Jul 29 00:35:44.866894 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.866860    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" containerName="main"
Jul 29 00:35:44.866986 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.866918    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ea7cc62-76ac-486c-93ee-042fea6ec397" containerName="main"
Jul 29 00:35:44.866986 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.866929    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="42da4e2c-d1e8-457a-80c2-6c07cb3bf9db" containerName="main"
Jul 29 00:35:44.869955 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.869939    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.873773 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.873746    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4b0b4c35-openshift-default-dockercfg-94cgd\""
Jul 29 00:35:44.895194 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.895170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:44.950149 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950119    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istiod-ca-cert\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.950314 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-credential-socket\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.950314 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d44w\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-kube-api-access-7d44w\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.950314 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950258    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-podinfo\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.950314 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-token\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.950450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950318    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-socket\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.950450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-certs\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.950450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950371    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-envoy\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.950450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.950388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-data\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:44.962082 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:44.962055    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"]
Jul 29 00:35:45.051192 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-podinfo\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051192 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-token\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-socket\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-certs\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-envoy\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-data\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051697 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istiod-ca-cert\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051697 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-credential-socket\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051697 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051549    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d44w\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-kube-api-access-7d44w\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051919 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051720    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-socket\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051919 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-data\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.051919 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-certs\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.052080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.051944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-credential-socket\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.052166 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.052147    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istiod-ca-cert\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.054339 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.054316    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-envoy\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.054478 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.054463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-podinfo\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.061686 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.061648    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-token\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.061956 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.061940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d44w\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-kube-api-access-7d44w\") pod \"e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") " pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.179660 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.179574    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:45.221503 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.221467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:45.353831 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.353770    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"]
Jul 29 00:35:45.356434 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:35:45.356399    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d1977f_0f80_4818_8f9d_4c41a9059bb2.slice/crio-b4324c7d8d3e2b79c08bdaa699c395a09da5f1a9cabb977a953d19451c783483 WatchSource:0}: Error finding container b4324c7d8d3e2b79c08bdaa699c395a09da5f1a9cabb977a953d19451c783483: Status 404 returned error can't find the container with id b4324c7d8d3e2b79c08bdaa699c395a09da5f1a9cabb977a953d19451c783483
Jul 29 00:35:45.358515 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.358474    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:35:45.358613 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.358571    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:35:45.358698 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:45.358618    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:35:46.068738 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:46.068697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" event={"ID":"72d1977f-0f80-4818-8f9d-4c41a9059bb2","Type":"ContainerStarted","Data":"2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5"}
Jul 29 00:35:46.068906 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:46.068788    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" event={"ID":"72d1977f-0f80-4818-8f9d-4c41a9059bb2","Type":"ContainerStarted","Data":"b4324c7d8d3e2b79c08bdaa699c395a09da5f1a9cabb977a953d19451c783483"}
Jul 29 00:35:46.096809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:46.096768    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" podStartSLOduration=2.096755064 podStartE2EDuration="2.096755064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:35:46.096010305 +0000 UTC m=+1677.660463256" watchObservedRunningTime="2026-07-29 00:35:46.096755064 +0000 UTC m=+1677.661208015"
Jul 29 00:35:46.180295 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:46.180266    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:46.186156 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:46.186131    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:47.074734 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:47.074695    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:47.075839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:47.075815    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:35:47.462124 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:47.462088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:47.559370 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:47.559339    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:47.687660 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:47.687630    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:47.857299 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:47.857209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:48.270983 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:48.270944    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:48.371392 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:48.371357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:35:59.141080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:59.140996    2559 generic.go:356] "Generic (PLEG): container finished" podID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerID="2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5" exitCode=0
Jul 29 00:35:59.141080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:59.141063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" event={"ID":"72d1977f-0f80-4818-8f9d-4c41a9059bb2","Type":"ContainerDied","Data":"2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5"}
Jul 29 00:35:59.141503 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:59.141391    2559 scope.go:117] "RemoveContainer" containerID="2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5"
Jul 29 00:35:59.142516 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:59.142490    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:35:59.142574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:59.142554    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:35:59.142625 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:35:59.142592    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:36:00.147573 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:00.147541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" event={"ID":"72d1977f-0f80-4818-8f9d-4c41a9059bb2","Type":"ContainerStarted","Data":"02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c"}
Jul 29 00:36:00.181392 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:00.181348    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:36:00.181595 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:00.181524    2559 patch_prober.go:28] interesting pod/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 00:36:00.181687 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:00.181584    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 00:36:01.180658 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:01.180626    2559 patch_prober.go:28] interesting pod/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 00:36:01.181256 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:01.181228    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 00:36:02.075247 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:02.075203    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:36:02.180031 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:02.179987    2559 patch_prober.go:28] interesting pod/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 00:36:02.180236 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:02.180054    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 00:36:03.182694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:03.180245    2559 patch_prober.go:28] interesting pod/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 00:36:03.182694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:03.180330    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 00:36:04.184615 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:04.184589    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:36:04.185524 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:04.185506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:36:13.018156 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.018078    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"]
Jul 29 00:36:13.021842 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.021826    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"
Jul 29 00:36:13.024848 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.024828    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:36:13.024958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.024910    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:36:13.030925 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.030901    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"]
Jul 29 00:36:13.101126 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.101084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5151d-9d76-46e7-9535-3e1d4d28481e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb\" (UID: \"2cb5151d-9d76-46e7-9535-3e1d4d28481e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"
Jul 29 00:36:13.202569 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.202531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5151d-9d76-46e7-9535-3e1d4d28481e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb\" (UID: \"2cb5151d-9d76-46e7-9535-3e1d4d28481e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"
Jul 29 00:36:13.203161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.203131    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5151d-9d76-46e7-9535-3e1d4d28481e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb\" (UID: \"2cb5151d-9d76-46e7-9535-3e1d4d28481e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"
Jul 29 00:36:13.332570 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.332476    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"
Jul 29 00:36:13.675216 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:13.675191    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"]
Jul 29 00:36:13.677129 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:36:13.677099    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb5151d_9d76_46e7_9535_3e1d4d28481e.slice/crio-57db32f0ccf6d47a50fa318b84c11754a4b0278c8310b6d4db575aef1d4ff817 WatchSource:0}: Error finding container 57db32f0ccf6d47a50fa318b84c11754a4b0278c8310b6d4db575aef1d4ff817: Status 404 returned error can't find the container with id 57db32f0ccf6d47a50fa318b84c11754a4b0278c8310b6d4db575aef1d4ff817
Jul 29 00:36:14.228707 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:14.228653    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb" event={"ID":"2cb5151d-9d76-46e7-9535-3e1d4d28481e","Type":"ContainerStarted","Data":"80b6828f8ca960308a90d36bf4aef144d56c46c9db4bbf32a5509eaa6872fe15"}
Jul 29 00:36:14.229163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:14.228733    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb" event={"ID":"2cb5151d-9d76-46e7-9535-3e1d4d28481e","Type":"ContainerStarted","Data":"57db32f0ccf6d47a50fa318b84c11754a4b0278c8310b6d4db575aef1d4ff817"}
Jul 29 00:36:14.246900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:14.246859    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb" podStartSLOduration=2.246845061 podStartE2EDuration="2.246845061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:14.246278056 +0000 UTC m=+1705.810731013" watchObservedRunningTime="2026-07-29 00:36:14.246845061 +0000 UTC m=+1705.811298013"
Jul 29 00:36:15.234944 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:15.234907    2559 generic.go:356] "Generic (PLEG): container finished" podID="2cb5151d-9d76-46e7-9535-3e1d4d28481e" containerID="80b6828f8ca960308a90d36bf4aef144d56c46c9db4bbf32a5509eaa6872fe15" exitCode=0
Jul 29 00:36:15.235405 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:15.234949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb" event={"ID":"2cb5151d-9d76-46e7-9535-3e1d4d28481e","Type":"ContainerDied","Data":"80b6828f8ca960308a90d36bf4aef144d56c46c9db4bbf32a5509eaa6872fe15"}
Jul 29 00:36:16.377496 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:16.377474    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"
Jul 29 00:36:16.434032 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:16.433998    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5151d-9d76-46e7-9535-3e1d4d28481e-maas-api-service-ca\") pod \"2cb5151d-9d76-46e7-9535-3e1d4d28481e\" (UID: \"2cb5151d-9d76-46e7-9535-3e1d4d28481e\") "
Jul 29 00:36:16.434355 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:16.434333    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb5151d-9d76-46e7-9535-3e1d4d28481e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2cb5151d-9d76-46e7-9535-3e1d4d28481e" (UID: "2cb5151d-9d76-46e7-9535-3e1d4d28481e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:36:16.534602 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:16.534530    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb5151d-9d76-46e7-9535-3e1d4d28481e-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:17.246556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:17.246528    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"
Jul 29 00:36:17.246735 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:17.246525    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb" event={"ID":"2cb5151d-9d76-46e7-9535-3e1d4d28481e","Type":"ContainerDied","Data":"57db32f0ccf6d47a50fa318b84c11754a4b0278c8310b6d4db575aef1d4ff817"}
Jul 29 00:36:17.246735 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:17.246659    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57db32f0ccf6d47a50fa318b84c11754a4b0278c8310b6d4db575aef1d4ff817"
Jul 29 00:36:18.243994 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.243959    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:18.318479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.318448    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:18.388130 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.388101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:18.427702 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.427652    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"]
Jul 29 00:36:18.430346 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.430321    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4b0b4c35-8krhb"]
Jul 29 00:36:18.478418 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.478383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:18.610900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.610814    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"]
Jul 29 00:36:18.611080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.611057    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy" containerID="cri-o://02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c" gracePeriod=30
Jul 29 00:36:18.635610 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.635569    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:18.837873 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:18.837835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:19.011334 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.011299    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb5151d-9d76-46e7-9535-3e1d4d28481e" path="/var/lib/kubelet/pods/2cb5151d-9d76-46e7-9535-3e1d4d28481e/volumes"
Jul 29 00:36:19.120969 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.120933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:19.187335 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.187302    2559 patch_prober.go:28] interesting pod/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 00:36:19.187485 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.187356    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 00:36:19.217121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.217090    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:19.317889 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.317781    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:19.608469 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.608388    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"]
Jul 29 00:36:19.608853 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.608837    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb5151d-9d76-46e7-9535-3e1d4d28481e" containerName="revoke-keys"
Jul 29 00:36:19.608945 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.608855    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb5151d-9d76-46e7-9535-3e1d4d28481e" containerName="revoke-keys"
Jul 29 00:36:19.609000 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.608964    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cb5151d-9d76-46e7-9535-3e1d4d28481e" containerName="revoke-keys"
Jul 29 00:36:19.612175 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.612155    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.615569 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.615552    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1abe847c-gw-openshift-default-dockercfg-gdqjd\""
Jul 29 00:36:19.625513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.625490    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"]
Jul 29 00:36:19.641055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.641015    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:19.744585 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.744552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:19.765819 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.765791    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f454879-6ad9-4685-a544-bc5179eb954f-istio-podinfo\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.765819 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.765829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-socket\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.766022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.765849    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-certs\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.766022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.765877    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdvw2\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-kube-api-access-mdvw2\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.766022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.765947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-envoy\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.766022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.765992    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f454879-6ad9-4685-a544-bc5179eb954f-istiod-ca-cert\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.766170 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.766031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-credential-socket\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.766170 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.766048    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-istio-token\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.766170 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.766081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-data\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.868650 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.868618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f454879-6ad9-4685-a544-bc5179eb954f-istio-podinfo\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.868879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.868758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-socket\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.868879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.868789    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-certs\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.868879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.868817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdvw2\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-kube-api-access-mdvw2\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.868879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.868843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-envoy\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869094 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.868897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f454879-6ad9-4685-a544-bc5179eb954f-istiod-ca-cert\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869094 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.868954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-credential-socket\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869094 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.868980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-istio-token\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869094 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.869030    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-data\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869297 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.869189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-certs\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869441 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.869389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-data\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869632 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.869605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-socket\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.869848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-credential-socket\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.869999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.869900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f454879-6ad9-4685-a544-bc5179eb954f-istiod-ca-cert\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.871387 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.871365    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f454879-6ad9-4685-a544-bc5179eb954f-istio-podinfo\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.871654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.871631    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-envoy\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.878470 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.878444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdvw2\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-kube-api-access-mdvw2\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.878775 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.878755    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-istio-token\") pod \"e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") " pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:19.922195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:19.922161    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:20.063330 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:20.063299    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"]
Jul 29 00:36:20.067148 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:36:20.067113    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f454879_6ad9_4685_a544_bc5179eb954f.slice/crio-4db87c02f4e551a52ead79d4963acb5c8aa5d849e7eb9b1b91d229459a3d6984 WatchSource:0}: Error finding container 4db87c02f4e551a52ead79d4963acb5c8aa5d849e7eb9b1b91d229459a3d6984: Status 404 returned error can't find the container with id 4db87c02f4e551a52ead79d4963acb5c8aa5d849e7eb9b1b91d229459a3d6984
Jul 29 00:36:20.069900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:20.069873    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:36:20.069984 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:20.069939    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:36:20.069984 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:20.069969    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:36:20.261279 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:20.261245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" event={"ID":"9f454879-6ad9-4685-a544-bc5179eb954f","Type":"ContainerStarted","Data":"3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d"}
Jul 29 00:36:20.261463 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:20.261298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" event={"ID":"9f454879-6ad9-4685-a544-bc5179eb954f","Type":"ContainerStarted","Data":"4db87c02f4e551a52ead79d4963acb5c8aa5d849e7eb9b1b91d229459a3d6984"}
Jul 29 00:36:20.287089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:20.286954    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" podStartSLOduration=1.286935642 podStartE2EDuration="1.286935642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:36:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:36:20.285764792 +0000 UTC m=+1711.850217739" watchObservedRunningTime="2026-07-29 00:36:20.286935642 +0000 UTC m=+1711.851388594"
Jul 29 00:36:20.922836 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:20.922806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:21.886886 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:21.886855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:21.928360 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:21.928333    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:22.029871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:22.029842    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:22.165402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:22.165319    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:22.271022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:22.270990    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:22.271921 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:22.271899    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:22.630031 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:22.629983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:22.727210 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:22.727177    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:36:23.877452 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:23.877399    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:36:24.007750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.007721    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-certs\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.007750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.007755    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-socket\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.008013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.007784    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-credential-socket\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.008013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.007800    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-token\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.008013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.007863    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d44w\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-kube-api-access-7d44w\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.008013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.007881    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-envoy\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.008013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.007928    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-podinfo\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.008013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.007981    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istiod-ca-cert\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.008324 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.008029    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-data\") pod \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\" (UID: \"72d1977f-0f80-4818-8f9d-4c41a9059bb2\") "
Jul 29 00:36:24.008324 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.008083    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:36:24.008324 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.008131    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:36:24.008324 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.008151    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:36:24.008526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.008372    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.008526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.008392    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.008526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.008410    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.008526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.008453    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:36:24.009143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.009119    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-data" (OuterVolumeSpecName: "istio-data") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:36:24.010290 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.010261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-token" (OuterVolumeSpecName: "istio-token") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:36:24.010290 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.010260    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:36:24.010704 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.010642    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:36:24.010704 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.010644    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-kube-api-access-7d44w" (OuterVolumeSpecName: "kube-api-access-7d44w") pod "72d1977f-0f80-4818-8f9d-4c41a9059bb2" (UID: "72d1977f-0f80-4818-8f9d-4c41a9059bb2"). InnerVolumeSpecName "kube-api-access-7d44w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:36:24.108848 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.108817    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d44w\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-kube-api-access-7d44w\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.108848 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.108848    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.109267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.108862    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.109267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.108874    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.109267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.108884    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.109267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.108894    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72d1977f-0f80-4818-8f9d-4c41a9059bb2-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:24.284064 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.283972    2559 generic.go:356] "Generic (PLEG): container finished" podID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerID="02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c" exitCode=0
Jul 29 00:36:24.284064 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.284018    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"
Jul 29 00:36:24.284064 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.284048    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" event={"ID":"72d1977f-0f80-4818-8f9d-4c41a9059bb2","Type":"ContainerDied","Data":"02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c"}
Jul 29 00:36:24.284296 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.284096    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg" event={"ID":"72d1977f-0f80-4818-8f9d-4c41a9059bb2","Type":"ContainerDied","Data":"b4324c7d8d3e2b79c08bdaa699c395a09da5f1a9cabb977a953d19451c783483"}
Jul 29 00:36:24.284296 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.284118    2559 scope.go:117] "RemoveContainer" containerID="02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c"
Jul 29 00:36:24.298412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.298397    2559 scope.go:117] "RemoveContainer" containerID="2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5"
Jul 29 00:36:24.306358 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.306340    2559 scope.go:117] "RemoveContainer" containerID="02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c"
Jul 29 00:36:24.306603 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:36:24.306583    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c\": container with ID starting with 02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c not found: ID does not exist" containerID="02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c"
Jul 29 00:36:24.306661 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.306611    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c"} err="failed to get container status \"02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c\": rpc error: code = NotFound desc = could not find container \"02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c\": container with ID starting with 02f53e16201e0927eaf90d557c20e23218f99e982b826b0f1ac10f2a1729ae1c not found: ID does not exist"
Jul 29 00:36:24.306661 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.306629    2559 scope.go:117] "RemoveContainer" containerID="2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5"
Jul 29 00:36:24.306867 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:36:24.306854    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5\": container with ID starting with 2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5 not found: ID does not exist" containerID="2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5"
Jul 29 00:36:24.306906 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.306870    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5"} err="failed to get container status \"2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5\": rpc error: code = NotFound desc = could not find container \"2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5\": container with ID starting with 2e13915f40a4736f7edbeb3772bb26723c49f173c0caf401b6cfaaff3a4608b5 not found: ID does not exist"
Jul 29 00:36:24.313675 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.313635    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"]
Jul 29 00:36:24.316566 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:24.316545    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4b0b4c35-openshift-default-6678c5f798-w2qvg"]
Jul 29 00:36:25.012066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:25.012026    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" path="/var/lib/kubelet/pods/72d1977f-0f80-4818-8f9d-4c41a9059bb2/volumes"
Jul 29 00:36:36.348322 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:36.348230    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f454879-6ad9-4685-a544-bc5179eb954f" containerID="3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d" exitCode=0
Jul 29 00:36:36.348322 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:36.348304    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" event={"ID":"9f454879-6ad9-4685-a544-bc5179eb954f","Type":"ContainerDied","Data":"3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d"}
Jul 29 00:36:36.348808 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:36.348704    2559 scope.go:117] "RemoveContainer" containerID="3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d"
Jul 29 00:36:36.349649 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:36.349625    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:36:36.349766 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:36.349701    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:36:36.349766 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:36.349730    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:36:37.270947 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:37.270905    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:37.355445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:37.355401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" event={"ID":"9f454879-6ad9-4685-a544-bc5179eb954f","Type":"ContainerStarted","Data":"5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79"}
Jul 29 00:36:37.922420 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:37.922378    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:37.923431 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:37.923406    2559 patch_prober.go:28] interesting pod/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 29 00:36:37.923556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:37.923467    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 29 00:36:38.922928 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:38.922885    2559 patch_prober.go:28] interesting pod/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 29 00:36:38.923420 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:38.922967    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 29 00:36:39.922789 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:39.922752    2559 patch_prober.go:28] interesting pod/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 29 00:36:39.922974 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:39.922808    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 29 00:36:40.922961 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:40.922931    2559 patch_prober.go:28] interesting pod/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 29 00:36:40.923339 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:40.922980    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 29 00:36:41.926323 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:41.926294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:41.926735 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:41.926527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:41.927197 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:41.927171    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:36:51.944637 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.944597    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"]
Jul 29 00:36:51.945184 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.945164    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy"
Jul 29 00:36:51.945266 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.945188    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy"
Jul 29 00:36:51.945322 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.945300    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy"
Jul 29 00:36:51.945322 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.945315    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy"
Jul 29 00:36:51.948371 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.948350    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"
Jul 29 00:36:51.951420 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.951400    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:36:51.951420 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.951411    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:36:51.956545 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:51.956489    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"]
Jul 29 00:36:52.051754 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:52.051722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b215828e-18a5-4bd0-8a07-18116dbaa278-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl\" (UID: \"b215828e-18a5-4bd0-8a07-18116dbaa278\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"
Jul 29 00:36:52.153234 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:52.153201    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b215828e-18a5-4bd0-8a07-18116dbaa278-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl\" (UID: \"b215828e-18a5-4bd0-8a07-18116dbaa278\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"
Jul 29 00:36:52.153801 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:52.153781    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b215828e-18a5-4bd0-8a07-18116dbaa278-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl\" (UID: \"b215828e-18a5-4bd0-8a07-18116dbaa278\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"
Jul 29 00:36:52.260465 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:52.260399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"
Jul 29 00:36:52.600080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:52.600054    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"]
Jul 29 00:36:52.602009 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:36:52.601979    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb215828e_18a5_4bd0_8a07_18116dbaa278.slice/crio-ebbbe6e337cb48705b7eed4d7b24b9d3aef55f383c18a8a01297d3e9800e6888 WatchSource:0}: Error finding container ebbbe6e337cb48705b7eed4d7b24b9d3aef55f383c18a8a01297d3e9800e6888: Status 404 returned error can't find the container with id ebbbe6e337cb48705b7eed4d7b24b9d3aef55f383c18a8a01297d3e9800e6888
Jul 29 00:36:53.444327 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:53.444244    2559 generic.go:356] "Generic (PLEG): container finished" podID="b215828e-18a5-4bd0-8a07-18116dbaa278" containerID="fc01f7882a55329db909fb3f073197b0e06be6e338270d318333255aea776241" exitCode=0
Jul 29 00:36:53.444654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:53.444340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl" event={"ID":"b215828e-18a5-4bd0-8a07-18116dbaa278","Type":"ContainerDied","Data":"fc01f7882a55329db909fb3f073197b0e06be6e338270d318333255aea776241"}
Jul 29 00:36:53.444654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:53.444411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl" event={"ID":"b215828e-18a5-4bd0-8a07-18116dbaa278","Type":"ContainerStarted","Data":"ebbbe6e337cb48705b7eed4d7b24b9d3aef55f383c18a8a01297d3e9800e6888"}
Jul 29 00:36:54.584279 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:54.584251    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"
Jul 29 00:36:54.676545 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:54.676508    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b215828e-18a5-4bd0-8a07-18116dbaa278-maas-api-service-ca\") pod \"b215828e-18a5-4bd0-8a07-18116dbaa278\" (UID: \"b215828e-18a5-4bd0-8a07-18116dbaa278\") "
Jul 29 00:36:54.676943 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:54.676923    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b215828e-18a5-4bd0-8a07-18116dbaa278-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b215828e-18a5-4bd0-8a07-18116dbaa278" (UID: "b215828e-18a5-4bd0-8a07-18116dbaa278"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:36:54.777403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:54.777323    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b215828e-18a5-4bd0-8a07-18116dbaa278-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:36:55.454958 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:55.454926    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl" event={"ID":"b215828e-18a5-4bd0-8a07-18116dbaa278","Type":"ContainerDied","Data":"ebbbe6e337cb48705b7eed4d7b24b9d3aef55f383c18a8a01297d3e9800e6888"}
Jul 29 00:36:55.455135 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:55.454980    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebbbe6e337cb48705b7eed4d7b24b9d3aef55f383c18a8a01297d3e9800e6888"
Jul 29 00:36:55.455135 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:36:55.455005    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"
Jul 29 00:37:03.357581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.357535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:03.429472 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.429446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:03.505657 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.505623    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:03.562692 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.562629    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"]
Jul 29 00:37:03.566242 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.566214    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-1abe847c-xlmnl"]
Jul 29 00:37:03.569260 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.569221    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:03.703385 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.703345    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"]
Jul 29 00:37:03.703590 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.703566    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy" containerID="cri-o://5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79" gracePeriod=30
Jul 29 00:37:03.719380 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.719355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:03.982032 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:03.981945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:04.203000 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:04.202966    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:04.509464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:04.509433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:04.991386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:04.991350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:05.011489 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:05.011460    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b215828e-18a5-4bd0-8a07-18116dbaa278" path="/var/lib/kubelet/pods/b215828e-18a5-4bd0-8a07-18116dbaa278/volumes"
Jul 29 00:37:06.966356 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:06.966316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:07.075318 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:07.075281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:07.169905 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:07.169869    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:07.553070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:07.553037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:07.722279 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:07.722246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:07.871044 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:07.871018    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:08.964462 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:08.964400    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:37:09.100102 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100068    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-credential-socket\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100102 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100104    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-data\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100135    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f454879-6ad9-4685-a544-bc5179eb954f-istio-podinfo\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100160    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-socket\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100195    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdvw2\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-kube-api-access-mdvw2\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100283    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f454879-6ad9-4685-a544-bc5179eb954f-istiod-ca-cert\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100315    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-certs\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100375    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-envoy\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100397    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-istio-token\") pod \"9f454879-6ad9-4685-a544-bc5179eb954f\" (UID: \"9f454879-6ad9-4685-a544-bc5179eb954f\") "
Jul 29 00:37:09.100574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100490    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:37:09.100752 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100593    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:37:09.100752 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100658    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:37:09.100860 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.100754    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f454879-6ad9-4685-a544-bc5179eb954f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:37:09.101254 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.101228    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f454879-6ad9-4685-a544-bc5179eb954f-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.101552 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.101257    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.101552 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.101273    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.101552 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.101288    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.101552 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.101540    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:37:09.102551 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.102524    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f454879-6ad9-4685-a544-bc5179eb954f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:37:09.102684 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.102612    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-kube-api-access-mdvw2" (OuterVolumeSpecName: "kube-api-access-mdvw2") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "kube-api-access-mdvw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:37:09.102906 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.102884    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:37:09.102989 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.102970    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f454879-6ad9-4685-a544-bc5179eb954f" (UID: "9f454879-6ad9-4685-a544-bc5179eb954f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:37:09.202608 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.202566    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f454879-6ad9-4685-a544-bc5179eb954f-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.202608 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.202605    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdvw2\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-kube-api-access-mdvw2\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.202608 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.202617    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.202608 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.202625    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f454879-6ad9-4685-a544-bc5179eb954f-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.202883 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.202633    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f454879-6ad9-4685-a544-bc5179eb954f-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:09.526291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.526255    2559 generic.go:356] "Generic (PLEG): container finished" podID="9f454879-6ad9-4685-a544-bc5179eb954f" containerID="5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79" exitCode=0
Jul 29 00:37:09.526491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.526319    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"
Jul 29 00:37:09.526491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.526343    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" event={"ID":"9f454879-6ad9-4685-a544-bc5179eb954f","Type":"ContainerDied","Data":"5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79"}
Jul 29 00:37:09.526491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.526407    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn" event={"ID":"9f454879-6ad9-4685-a544-bc5179eb954f","Type":"ContainerDied","Data":"4db87c02f4e551a52ead79d4963acb5c8aa5d849e7eb9b1b91d229459a3d6984"}
Jul 29 00:37:09.526491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.526438    2559 scope.go:117] "RemoveContainer" containerID="5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79"
Jul 29 00:37:09.536066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.536051    2559 scope.go:117] "RemoveContainer" containerID="3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d"
Jul 29 00:37:09.544247 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.544230    2559 scope.go:117] "RemoveContainer" containerID="5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79"
Jul 29 00:37:09.544489 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:37:09.544470    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79\": container with ID starting with 5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79 not found: ID does not exist" containerID="5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79"
Jul 29 00:37:09.544545 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.544497    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79"} err="failed to get container status \"5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79\": rpc error: code = NotFound desc = could not find container \"5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79\": container with ID starting with 5734b648fc60894e2bdbcecfeb438917fa5725bb941ff46f45d9e02c119e2f79 not found: ID does not exist"
Jul 29 00:37:09.544545 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.544515    2559 scope.go:117] "RemoveContainer" containerID="3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d"
Jul 29 00:37:09.544800 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:37:09.544782    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d\": container with ID starting with 3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d not found: ID does not exist" containerID="3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d"
Jul 29 00:37:09.544850 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.544802    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d"} err="failed to get container status \"3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d\": rpc error: code = NotFound desc = could not find container \"3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d\": container with ID starting with 3d77741fa3984e14be449b7874e1c6c359326d06ee95db2b4de54d768e7b732d not found: ID does not exist"
Jul 29 00:37:09.551168 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.551148    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"]
Jul 29 00:37:09.555542 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:09.555519    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1abe847c-gw-openshift-default-548bdc68f6-9wvgn"]
Jul 29 00:37:11.011208 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:11.011175    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" path="/var/lib/kubelet/pods/9f454879-6ad9-4685-a544-bc5179eb954f/volumes"
Jul 29 00:37:32.721389 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721355    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"]
Jul 29 00:37:32.721815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721745    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy"
Jul 29 00:37:32.721815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721758    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="72d1977f-0f80-4818-8f9d-4c41a9059bb2" containerName="istio-proxy"
Jul 29 00:37:32.721815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721767    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy"
Jul 29 00:37:32.721815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721773    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy"
Jul 29 00:37:32.721815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721784    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy"
Jul 29 00:37:32.721815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721790    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy"
Jul 29 00:37:32.721815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721802    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b215828e-18a5-4bd0-8a07-18116dbaa278" containerName="revoke-keys"
Jul 29 00:37:32.721815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721810    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b215828e-18a5-4bd0-8a07-18116dbaa278" containerName="revoke-keys"
Jul 29 00:37:32.722062 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721911    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy"
Jul 29 00:37:32.722062 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721920    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f454879-6ad9-4685-a544-bc5179eb954f" containerName="istio-proxy"
Jul 29 00:37:32.722062 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.721928    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b215828e-18a5-4bd0-8a07-18116dbaa278" containerName="revoke-keys"
Jul 29 00:37:32.725079 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.725063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"
Jul 29 00:37:32.728106 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.728082    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:37:32.728206 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.728088    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:37:32.731786 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.731763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"]
Jul 29 00:37:32.804323 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.804297    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff3d824-09da-4f78-8581-dfdbe846da6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs\" (UID: \"aff3d824-09da-4f78-8581-dfdbe846da6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"
Jul 29 00:37:32.904698 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.904660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff3d824-09da-4f78-8581-dfdbe846da6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs\" (UID: \"aff3d824-09da-4f78-8581-dfdbe846da6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"
Jul 29 00:37:32.905229 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:32.905213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff3d824-09da-4f78-8581-dfdbe846da6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs\" (UID: \"aff3d824-09da-4f78-8581-dfdbe846da6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"
Jul 29 00:37:33.037080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:33.037014    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"
Jul 29 00:37:33.167757 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:33.167725    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"]
Jul 29 00:37:33.169951 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:37:33.169925    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff3d824_09da_4f78_8581_dfdbe846da6f.slice/crio-78864bb33a9149c13fcdd6e1e720daeb388032ed5320b848ac7e8cfdc540c8ac WatchSource:0}: Error finding container 78864bb33a9149c13fcdd6e1e720daeb388032ed5320b848ac7e8cfdc540c8ac: Status 404 returned error can't find the container with id 78864bb33a9149c13fcdd6e1e720daeb388032ed5320b848ac7e8cfdc540c8ac
Jul 29 00:37:33.646549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:33.646466    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs" event={"ID":"aff3d824-09da-4f78-8581-dfdbe846da6f","Type":"ContainerStarted","Data":"19e14be9e61320517baa6b6725387422df9f9988ff34cb995423846aeaa6f40f"}
Jul 29 00:37:33.646549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:33.646517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs" event={"ID":"aff3d824-09da-4f78-8581-dfdbe846da6f","Type":"ContainerStarted","Data":"78864bb33a9149c13fcdd6e1e720daeb388032ed5320b848ac7e8cfdc540c8ac"}
Jul 29 00:37:33.664285 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:33.664238    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs" podStartSLOduration=1.6642239970000001 podStartE2EDuration="1.664223997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:33.661805252 +0000 UTC m=+1785.226258206" watchObservedRunningTime="2026-07-29 00:37:33.664223997 +0000 UTC m=+1785.228676948"
Jul 29 00:37:34.653076 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:34.653046    2559 generic.go:356] "Generic (PLEG): container finished" podID="aff3d824-09da-4f78-8581-dfdbe846da6f" containerID="19e14be9e61320517baa6b6725387422df9f9988ff34cb995423846aeaa6f40f" exitCode=0
Jul 29 00:37:34.653526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:34.653144    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs" event={"ID":"aff3d824-09da-4f78-8581-dfdbe846da6f","Type":"ContainerDied","Data":"19e14be9e61320517baa6b6725387422df9f9988ff34cb995423846aeaa6f40f"}
Jul 29 00:37:35.791289 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:35.791265    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"
Jul 29 00:37:35.832689 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:35.832645    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff3d824-09da-4f78-8581-dfdbe846da6f-maas-api-service-ca\") pod \"aff3d824-09da-4f78-8581-dfdbe846da6f\" (UID: \"aff3d824-09da-4f78-8581-dfdbe846da6f\") "
Jul 29 00:37:35.833023 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:35.832999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff3d824-09da-4f78-8581-dfdbe846da6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aff3d824-09da-4f78-8581-dfdbe846da6f" (UID: "aff3d824-09da-4f78-8581-dfdbe846da6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:37:35.934077 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:35.933997    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff3d824-09da-4f78-8581-dfdbe846da6f-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:37:36.664203 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:36.664166    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs" event={"ID":"aff3d824-09da-4f78-8581-dfdbe846da6f","Type":"ContainerDied","Data":"78864bb33a9149c13fcdd6e1e720daeb388032ed5320b848ac7e8cfdc540c8ac"}
Jul 29 00:37:36.664370 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:36.664220    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78864bb33a9149c13fcdd6e1e720daeb388032ed5320b848ac7e8cfdc540c8ac"
Jul 29 00:37:36.664370 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:36.664186    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"
Jul 29 00:37:37.967783 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:37.967751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:38.145545 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:38.145515    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"]
Jul 29 00:37:38.148232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:38.148204    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a969ca8e-xvwvs"]
Jul 29 00:37:39.012280 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:39.012245    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff3d824-09da-4f78-8581-dfdbe846da6f" path="/var/lib/kubelet/pods/aff3d824-09da-4f78-8581-dfdbe846da6f/volumes"
Jul 29 00:37:40.066349 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.066272    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"]
Jul 29 00:37:40.066808 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.066793    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff3d824-09da-4f78-8581-dfdbe846da6f" containerName="revoke-keys"
Jul 29 00:37:40.066808 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.066807    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff3d824-09da-4f78-8581-dfdbe846da6f" containerName="revoke-keys"
Jul 29 00:37:40.066988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.066967    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff3d824-09da-4f78-8581-dfdbe846da6f" containerName="revoke-keys"
Jul 29 00:37:40.070309 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.070291    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.073000 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.072977    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a0eed2d7-openshift-default-dockercfg-2jslz\""
Jul 29 00:37:40.082315 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.082295    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"]
Jul 29 00:37:40.169082 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-token\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.169291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169126    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-certs\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.169291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169150    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-data\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.169291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-credential-socket\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.169291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-envoy\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.169291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-socket\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.169538 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvkf9\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-kube-api-access-qvkf9\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.169538 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-podinfo\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.169538 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.169363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istiod-ca-cert\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.270693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.270628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-credential-socket\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.270884 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.270708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-envoy\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.270884 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.270745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-socket\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.270884 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.270794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvkf9\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-kube-api-access-qvkf9\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.270884 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.270833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-podinfo\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.270972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istiod-ca-cert\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.271091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-token\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.271158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-socket\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.271244    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-certs\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.271275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-data\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.271301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-credential-socket\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.271486    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-certs\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.271536    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-data\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.271839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.271659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istiod-ca-cert\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.273126 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.273106    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-envoy\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.273639 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.273616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-podinfo\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.279251 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.279228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvkf9\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-kube-api-access-qvkf9\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.279464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.279447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-token\") pod \"e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") " pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.303380 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.303355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:40.381478 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.381449    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:40.524098 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.524074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"]
Jul 29 00:37:40.525909 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:37:40.525883    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9364bfd9_bac3_40be_b8f8_7fb7fb37b67c.slice/crio-63168fa2c6540ab1a038bf404c6050b489b072d1f4b0e6245dda881c6863b755 WatchSource:0}: Error finding container 63168fa2c6540ab1a038bf404c6050b489b072d1f4b0e6245dda881c6863b755: Status 404 returned error can't find the container with id 63168fa2c6540ab1a038bf404c6050b489b072d1f4b0e6245dda881c6863b755
Jul 29 00:37:40.528223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.528192    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:37:40.528350 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.528276    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:37:40.528350 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.528306    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:37:40.692592 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.692499    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" event={"ID":"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c","Type":"ContainerStarted","Data":"dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e"}
Jul 29 00:37:40.692592 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.692560    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" event={"ID":"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c","Type":"ContainerStarted","Data":"63168fa2c6540ab1a038bf404c6050b489b072d1f4b0e6245dda881c6863b755"}
Jul 29 00:37:40.713226 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:40.713172    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" podStartSLOduration=0.713157315 podStartE2EDuration="713.157315ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:37:40.712478895 +0000 UTC m=+1792.276931850" watchObservedRunningTime="2026-07-29 00:37:40.713157315 +0000 UTC m=+1792.277610266"
Jul 29 00:37:41.381841 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:41.381802    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:41.386629 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:41.386603    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:41.698684 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:41.698573    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:41.699585 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:41.699565    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:42.065468 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:42.065381    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:42.152899 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:42.152870    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:42.235449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:42.235412    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:42.685938 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:42.685886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:43.059166 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:43.059080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:43.159907 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:43.159864    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:49.016895 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:49.016870    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:37:49.017926 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:49.017911    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:37:49.020842 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:49.020822    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:37:49.021775 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:49.021753    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:37:55.770534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:55.770501    2559 generic.go:356] "Generic (PLEG): container finished" podID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerID="dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e" exitCode=0
Jul 29 00:37:55.771055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:55.770576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" event={"ID":"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c","Type":"ContainerDied","Data":"dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e"}
Jul 29 00:37:55.771055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:55.771008    2559 scope.go:117] "RemoveContainer" containerID="dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e"
Jul 29 00:37:55.772019 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:55.771993    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:37:55.772081 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:55.772059    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:37:55.772116 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:55.772096    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:37:56.698556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:56.698519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:56.781074 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:56.781026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" event={"ID":"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c","Type":"ContainerStarted","Data":"4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010"}
Jul 29 00:37:57.382724 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:57.382616    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:37:57.383701 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:57.383650    2559 patch_prober.go:28] interesting pod/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 29 00:37:57.383844 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:57.383730    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 29 00:37:58.382767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:58.382723    2559 patch_prober.go:28] interesting pod/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 29 00:37:58.383265 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:58.382792    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 29 00:37:58.495216 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:58.495180    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:37:59.382200 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:59.382158    2559 patch_prober.go:28] interesting pod/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 29 00:37:59.382502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:37:59.382471    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 29 00:38:00.382323 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:00.382282    2559 patch_prober.go:28] interesting pod/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 29 00:38:00.382962 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:00.382931    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 29 00:38:01.385544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:01.385516    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:38:01.385942 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:01.385824    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:38:01.386543 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:01.386523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:38:06.945081 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:06.945045    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"]
Jul 29 00:38:06.948892 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:06.948877    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"
Jul 29 00:38:06.951632 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:06.951609    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:38:06.951756 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:06.951633    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:38:06.958877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:06.958857    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"]
Jul 29 00:38:07.133397 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:07.133363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04cf7986-014f-4737-9290-18e4d5df59af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9\" (UID: \"04cf7986-014f-4737-9290-18e4d5df59af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"
Jul 29 00:38:07.234903 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:07.234819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04cf7986-014f-4737-9290-18e4d5df59af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9\" (UID: \"04cf7986-014f-4737-9290-18e4d5df59af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"
Jul 29 00:38:07.235433 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:07.235414    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04cf7986-014f-4737-9290-18e4d5df59af-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9\" (UID: \"04cf7986-014f-4737-9290-18e4d5df59af\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"
Jul 29 00:38:07.260166 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:07.260146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"
Jul 29 00:38:07.394848 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:07.394787    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"]
Jul 29 00:38:07.395063 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:38:07.395030    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04cf7986_014f_4737_9290_18e4d5df59af.slice/crio-7a9d79a832cb177212e5eb30760e00cbc0834c4a96983ee299eecae680d8430e WatchSource:0}: Error finding container 7a9d79a832cb177212e5eb30760e00cbc0834c4a96983ee299eecae680d8430e: Status 404 returned error can't find the container with id 7a9d79a832cb177212e5eb30760e00cbc0834c4a96983ee299eecae680d8430e
Jul 29 00:38:07.842709 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:07.842588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9" event={"ID":"04cf7986-014f-4737-9290-18e4d5df59af","Type":"ContainerStarted","Data":"230545c2bab96259e4cf45b627034b6a78939ac36ccd758d876da94914c9fa23"}
Jul 29 00:38:07.842709 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:07.842650    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9" event={"ID":"04cf7986-014f-4737-9290-18e4d5df59af","Type":"ContainerStarted","Data":"7a9d79a832cb177212e5eb30760e00cbc0834c4a96983ee299eecae680d8430e"}
Jul 29 00:38:07.859072 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:07.859032    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9" podStartSLOduration=1.8590184060000001 podStartE2EDuration="1.859018406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:38:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:38:07.857316027 +0000 UTC m=+1819.421768979" watchObservedRunningTime="2026-07-29 00:38:07.859018406 +0000 UTC m=+1819.423471359"
Jul 29 00:38:08.848936 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:08.848898    2559 generic.go:356] "Generic (PLEG): container finished" podID="04cf7986-014f-4737-9290-18e4d5df59af" containerID="230545c2bab96259e4cf45b627034b6a78939ac36ccd758d876da94914c9fa23" exitCode=0
Jul 29 00:38:08.849319 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:08.848990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9" event={"ID":"04cf7986-014f-4737-9290-18e4d5df59af","Type":"ContainerDied","Data":"230545c2bab96259e4cf45b627034b6a78939ac36ccd758d876da94914c9fa23"}
Jul 29 00:38:09.985411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:09.985389    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"
Jul 29 00:38:10.059588 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:10.059555    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04cf7986-014f-4737-9290-18e4d5df59af-maas-api-service-ca\") pod \"04cf7986-014f-4737-9290-18e4d5df59af\" (UID: \"04cf7986-014f-4737-9290-18e4d5df59af\") "
Jul 29 00:38:10.060014 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:10.059981    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04cf7986-014f-4737-9290-18e4d5df59af-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04cf7986-014f-4737-9290-18e4d5df59af" (UID: "04cf7986-014f-4737-9290-18e4d5df59af"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:38:10.160394 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:10.160357    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04cf7986-014f-4737-9290-18e4d5df59af-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:10.860520 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:10.860491    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"
Jul 29 00:38:10.860750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:10.860488    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9" event={"ID":"04cf7986-014f-4737-9290-18e4d5df59af","Type":"ContainerDied","Data":"7a9d79a832cb177212e5eb30760e00cbc0834c4a96983ee299eecae680d8430e"}
Jul 29 00:38:10.860750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:10.860640    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a9d79a832cb177212e5eb30760e00cbc0834c4a96983ee299eecae680d8430e"
Jul 29 00:38:12.902580 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:12.902532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:13.000592 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.000549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:13.082098 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.082070    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"]
Jul 29 00:38:13.086215 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.086192    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a0eed2d7-rbtq9"]
Jul 29 00:38:13.086549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.086529    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:13.167555 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.167464    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:13.307768 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.307733    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"]
Jul 29 00:38:13.307970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.307946    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy" containerID="cri-o://4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010" gracePeriod=30
Jul 29 00:38:13.355584 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.355558    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:13.546096 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:13.546007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:14.003880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:14.003850    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:14.079300 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:14.079257    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:14.180283 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:14.180249    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:15.011542 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:15.011509    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04cf7986-014f-4737-9290-18e4d5df59af" path="/var/lib/kubelet/pods/04cf7986-014f-4737-9290-18e4d5df59af/volumes"
Jul 29 00:38:15.626475 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:15.626438    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:16.388502 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:16.388466    2559 patch_prober.go:28] interesting pod/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 00:38:16.388987 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:16.388527    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 00:38:18.562842 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.562817    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:38:18.637034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637007    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-socket\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637164 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637049    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-podinfo\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637164 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637089    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-credential-socket\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637164 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637114    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-data\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637164 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637128    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-envoy\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637164 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637148    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istiod-ca-cert\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637409 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637271    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-token\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637409 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:38:18.637409 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637315    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvkf9\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-kube-api-access-qvkf9\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637409 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637397    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:38:18.637625 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637454    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-certs\") pod \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\" (UID: \"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c\") "
Jul 29 00:38:18.637625 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637571    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:38:18.637821 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637798    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:38:18.637950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637872    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.637950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637891    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.637950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637904    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.637950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.637921    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.638267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.638118    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-data" (OuterVolumeSpecName: "istio-data") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:38:18.639569 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.639546    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:38:18.639701 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.639644    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-kube-api-access-qvkf9" (OuterVolumeSpecName: "kube-api-access-qvkf9") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "kube-api-access-qvkf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:38:18.639951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.639929    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:38:18.639951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.639933    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-token" (OuterVolumeSpecName: "istio-token") pod "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" (UID: "9364bfd9-bac3-40be-b8f8-7fb7fb37b67c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:38:18.738689 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.738649    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.738791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.738695    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvkf9\" (UniqueName: \"kubernetes.io/projected/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-kube-api-access-qvkf9\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.738791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.738711    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.738791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.738723    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.738791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.738732    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:38:18.902573 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.902498    2559 generic.go:356] "Generic (PLEG): container finished" podID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerID="4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010" exitCode=0
Jul 29 00:38:18.902573 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.902554    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"
Jul 29 00:38:18.902804 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.902583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" event={"ID":"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c","Type":"ContainerDied","Data":"4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010"}
Jul 29 00:38:18.902804 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.902640    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph" event={"ID":"9364bfd9-bac3-40be-b8f8-7fb7fb37b67c","Type":"ContainerDied","Data":"63168fa2c6540ab1a038bf404c6050b489b072d1f4b0e6245dda881c6863b755"}
Jul 29 00:38:18.902804 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.902656    2559 scope.go:117] "RemoveContainer" containerID="4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010"
Jul 29 00:38:18.911865 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.911847    2559 scope.go:117] "RemoveContainer" containerID="dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e"
Jul 29 00:38:18.919654 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.919638    2559 scope.go:117] "RemoveContainer" containerID="4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010"
Jul 29 00:38:18.919910 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:38:18.919894    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010\": container with ID starting with 4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010 not found: ID does not exist" containerID="4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010"
Jul 29 00:38:18.919973 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.919917    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010"} err="failed to get container status \"4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010\": rpc error: code = NotFound desc = could not find container \"4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010\": container with ID starting with 4b86bc43e19689466a2196caaa83d6130916c9658210f70d755aa3c16d476010 not found: ID does not exist"
Jul 29 00:38:18.919973 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.919932    2559 scope.go:117] "RemoveContainer" containerID="dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e"
Jul 29 00:38:18.920155 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:38:18.920138    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e\": container with ID starting with dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e not found: ID does not exist" containerID="dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e"
Jul 29 00:38:18.920202 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.920162    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e"} err="failed to get container status \"dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e\": rpc error: code = NotFound desc = could not find container \"dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e\": container with ID starting with dbb4060cf9537ced97c582ec5746cd3877c43ca03da74c4e129dcde948f7a14e not found: ID does not exist"
Jul 29 00:38:18.926611 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.926589    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"]
Jul 29 00:38:18.933159 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:18.933138    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a0eed2d7-openshift-default-6cf5656fb8-zpdph"]
Jul 29 00:38:19.011190 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:19.011163    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" path="/var/lib/kubelet/pods/9364bfd9-bac3-40be-b8f8-7fb7fb37b67c/volumes"
Jul 29 00:38:21.556684 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:21.556626    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:21.678093 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:21.678061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:21.820218 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:21.820133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:21.915959 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:21.915933    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:22.323251 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:22.323214    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:25.272402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:25.272364    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:48.301346 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:48.301309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:54.351992 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:54.351960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:54.459583 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:54.459551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:38:54.551363 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:38:54.551333    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:10.424611 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:10.424507    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:15.975235 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:15.975204    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:16.030171 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:16.030121    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:16.103727 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:16.103697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:16.203179 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:16.203154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:26.693291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:26.693254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:27.467298 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:27.467266    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:33.411559 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:33.411525    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:33.518916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:33.518883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:33.613592 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:33.613560    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:33.711564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:33.711490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:51.557300 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:51.557264    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:51.655152 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:51.655126    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:51.755293 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:51.755262    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:53.500423 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:53.500390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:59.583951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:59.583920    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:39:59.692953 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:39:59.692909    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:00.250545 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:00.250508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:06.026893 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.026861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:06.321733 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.321641    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:06.423316 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.423281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:06.546305 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546272    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"]
Jul 29 00:40:06.546682 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546651    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy"
Jul 29 00:40:06.546682 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546679    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy"
Jul 29 00:40:06.546761 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546692    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy"
Jul 29 00:40:06.546761 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546699    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy"
Jul 29 00:40:06.546761 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546710    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04cf7986-014f-4737-9290-18e4d5df59af" containerName="revoke-keys"
Jul 29 00:40:06.546761 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546717    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="04cf7986-014f-4737-9290-18e4d5df59af" containerName="revoke-keys"
Jul 29 00:40:06.546889 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546779    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy"
Jul 29 00:40:06.546889 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546789    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9364bfd9-bac3-40be-b8f8-7fb7fb37b67c" containerName="istio-proxy"
Jul 29 00:40:06.546889 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.546794    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="04cf7986-014f-4737-9290-18e4d5df59af" containerName="revoke-keys"
Jul 29 00:40:06.549800 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.549782    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.552538 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.552520    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bce29f49-openshift-default-dockercfg-p29kk\""
Jul 29 00:40:06.568871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.568845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"]
Jul 29 00:40:06.573166 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.573101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:06.664108 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-token\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.664288 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-credential-socket\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.664288 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-data\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.664395 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-socket\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.664395 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-envoy\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.664395 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a30d9e-134e-4cee-acb3-8e3aad121c35-istiod-ca-cert\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.664512 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664414    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-podinfo\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.664512 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-certs\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.664645 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.664538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg28r\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-kube-api-access-hg28r\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.765999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.765959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-certs\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg28r\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-kube-api-access-hg28r\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-token\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766195 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-credential-socket\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766377 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-data\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766377 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-socket\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766377 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-envoy\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766532 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-certs\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766532 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a30d9e-134e-4cee-acb3-8e3aad121c35-istiod-ca-cert\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766532 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-podinfo\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766701 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766622    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-data\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766858 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766833    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-socket\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.766940 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.766883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-credential-socket\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.767103 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.767080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a30d9e-134e-4cee-acb3-8e3aad121c35-istiod-ca-cert\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.768912 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.768891    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-envoy\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.769196 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.769175    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-podinfo\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.774230 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.774206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-token\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.774572 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.774554    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg28r\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-kube-api-access-hg28r\") pod \"e2e-mt-bce29f49-openshift-default-55585b947b-4hsph\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") " pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:06.837199 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.837120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:06.860656 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:06.860628    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:07.010157 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:40:07.010125    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a30d9e_134e_4cee_acb3_8e3aad121c35.slice/crio-dc99b86dc3e8d6bb5ea72a6486f55d374ec9c0f2931315560c2299f2b07e754a WatchSource:0}: Error finding container dc99b86dc3e8d6bb5ea72a6486f55d374ec9c0f2931315560c2299f2b07e754a: Status 404 returned error can't find the container with id dc99b86dc3e8d6bb5ea72a6486f55d374ec9c0f2931315560c2299f2b07e754a
Jul 29 00:40:07.014716 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:07.013611    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"]
Jul 29 00:40:07.019971 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:07.019935    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:40:07.020097 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:07.020023    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:40:07.020097 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:07.020065    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:40:07.439131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:07.439091    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" event={"ID":"94a30d9e-134e-4cee-acb3-8e3aad121c35","Type":"ContainerStarted","Data":"c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2"}
Jul 29 00:40:07.439528 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:07.439155    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" event={"ID":"94a30d9e-134e-4cee-acb3-8e3aad121c35","Type":"ContainerStarted","Data":"dc99b86dc3e8d6bb5ea72a6486f55d374ec9c0f2931315560c2299f2b07e754a"}
Jul 29 00:40:07.460321 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:07.460266    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" podStartSLOduration=1.460251409 podStartE2EDuration="1.460251409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:40:07.45690407 +0000 UTC m=+1939.021357022" watchObservedRunningTime="2026-07-29 00:40:07.460251409 +0000 UTC m=+1939.024704360"
Jul 29 00:40:07.861715 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:07.861607    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:08.866265 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:08.866225    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:09.357228 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:09.357148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:09.436565 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:09.436538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:09.450255 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:09.450228    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:09.451184 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:09.451161    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:09.501192 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:09.501163    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:09.769201 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:09.769173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:10.060163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:10.060068    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:10.149860 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:10.149823    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:10.809720 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:10.809689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:18.034086 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:18.034052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:18.088439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:18.088411    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:22.522134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:22.522102    2559 generic.go:356] "Generic (PLEG): container finished" podID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerID="c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2" exitCode=0
Jul 29 00:40:22.522543 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:22.522173    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" event={"ID":"94a30d9e-134e-4cee-acb3-8e3aad121c35","Type":"ContainerDied","Data":"c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2"}
Jul 29 00:40:22.522627 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:22.522613    2559 scope.go:117] "RemoveContainer" containerID="c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2"
Jul 29 00:40:22.523772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:22.523746    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:40:22.523853 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:22.523809    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:40:22.523853 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:22.523841    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:40:23.528827 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:23.528791    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" event={"ID":"94a30d9e-134e-4cee-acb3-8e3aad121c35","Type":"ContainerStarted","Data":"c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6"}
Jul 29 00:40:23.862280 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:23.862175    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:23.862458 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:23.862361    2559 patch_prober.go:28] interesting pod/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 29 00:40:23.862458 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:23.862405    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 29 00:40:24.451080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:24.451042    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:24.861267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:24.861173    2559 patch_prober.go:28] interesting pod/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 29 00:40:24.861845 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:24.861811    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 29 00:40:25.861686 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:25.861625    2559 patch_prober.go:28] interesting pod/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 29 00:40:25.862205 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:25.861728    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 29 00:40:26.861642 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:26.861604    2559 patch_prober.go:28] interesting pod/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 29 00:40:26.861873 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:26.861693    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 29 00:40:27.865233 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:27.865201    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:27.866217 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:27.866194    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:40:34.337760 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:34.337730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:35.006368 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:35.006332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:35.105332 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:35.105298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:35.441531 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:35.441493    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:40.938014 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:40.937940    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:41.040620 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.040583    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:41.290575 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.290495    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"]
Jul 29 00:40:41.294041 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.294025    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"
Jul 29 00:40:41.296755 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.296732    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:40:41.296755 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.296745    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:40:41.300717 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.300692    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"]
Jul 29 00:40:41.359319 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.359273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0455f1e5-a309-4a1f-923d-f962b282d8a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bce29f49-5wksq\" (UID: \"0455f1e5-a309-4a1f-923d-f962b282d8a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"
Jul 29 00:40:41.460114 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.460077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0455f1e5-a309-4a1f-923d-f962b282d8a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bce29f49-5wksq\" (UID: \"0455f1e5-a309-4a1f-923d-f962b282d8a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"
Jul 29 00:40:41.460779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.460755    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0455f1e5-a309-4a1f-923d-f962b282d8a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-bce29f49-5wksq\" (UID: \"0455f1e5-a309-4a1f-923d-f962b282d8a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"
Jul 29 00:40:41.607453 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.607370    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"
Jul 29 00:40:41.736821 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:41.736796    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"]
Jul 29 00:40:41.739332 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:40:41.739297    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0455f1e5_a309_4a1f_923d_f962b282d8a7.slice/crio-f9356ca73cc26dd17927e7368fa713ee78b6b6d80a596961cad17584e1b98ceb WatchSource:0}: Error finding container f9356ca73cc26dd17927e7368fa713ee78b6b6d80a596961cad17584e1b98ceb: Status 404 returned error can't find the container with id f9356ca73cc26dd17927e7368fa713ee78b6b6d80a596961cad17584e1b98ceb
Jul 29 00:40:42.626349 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:42.626313    2559 generic.go:356] "Generic (PLEG): container finished" podID="0455f1e5-a309-4a1f-923d-f962b282d8a7" containerID="b4b3a448b99a130786407a6fc306db373212c14a7b0847c3cbca4be1171a7318" exitCode=0
Jul 29 00:40:42.626739 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:42.626399    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq" event={"ID":"0455f1e5-a309-4a1f-923d-f962b282d8a7","Type":"ContainerDied","Data":"b4b3a448b99a130786407a6fc306db373212c14a7b0847c3cbca4be1171a7318"}
Jul 29 00:40:42.626739 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:42.626452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq" event={"ID":"0455f1e5-a309-4a1f-923d-f962b282d8a7","Type":"ContainerStarted","Data":"f9356ca73cc26dd17927e7368fa713ee78b6b6d80a596961cad17584e1b98ceb"}
Jul 29 00:40:43.765292 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:43.765264    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"
Jul 29 00:40:43.780094 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:43.780063    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0455f1e5-a309-4a1f-923d-f962b282d8a7-maas-api-service-ca\") pod \"0455f1e5-a309-4a1f-923d-f962b282d8a7\" (UID: \"0455f1e5-a309-4a1f-923d-f962b282d8a7\") "
Jul 29 00:40:43.780551 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:43.780519    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0455f1e5-a309-4a1f-923d-f962b282d8a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0455f1e5-a309-4a1f-923d-f962b282d8a7" (UID: "0455f1e5-a309-4a1f-923d-f962b282d8a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:40:43.881375 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:43.881309    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0455f1e5-a309-4a1f-923d-f962b282d8a7-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:40:44.636954 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:44.636923    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"
Jul 29 00:40:44.636954 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:44.636948    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq" event={"ID":"0455f1e5-a309-4a1f-923d-f962b282d8a7","Type":"ContainerDied","Data":"f9356ca73cc26dd17927e7368fa713ee78b6b6d80a596961cad17584e1b98ceb"}
Jul 29 00:40:44.637233 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:44.636989    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9356ca73cc26dd17927e7368fa713ee78b6b6d80a596961cad17584e1b98ceb"
Jul 29 00:40:44.678469 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:40:44.678441    2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0455f1e5_a309_4a1f_923d_f962b282d8a7.slice\": RecentStats: unable to find data in memory cache]"
Jul 29 00:40:51.871274 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:51.871241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:51.941866 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:51.941836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:52.013423 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:52.013391    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:52.041450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:52.041423    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"]
Jul 29 00:40:52.043064 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:52.043046    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-bce29f49-5wksq"]
Jul 29 00:40:52.076625 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:52.076596    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:52.431336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:52.431302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:53.010960 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:53.010931    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0455f1e5-a309-4a1f-923d-f962b282d8a7" path="/var/lib/kubelet/pods/0455f1e5-a309-4a1f-923d-f962b282d8a7/volumes"
Jul 29 00:40:58.110875 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.110838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:58.211690 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.211648    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:58.356414 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.356384    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"]
Jul 29 00:40:58.356612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.356591    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy" containerID="cri-o://c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6" gracePeriod=30
Jul 29 00:40:58.371569 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.371535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:58.599690 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.599645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:58.758252 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.758170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:58.875203 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.875153    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:40:58.975511 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:40:58.975479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:03.610799 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.610774    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:41:03.741789 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.741705    2559 generic.go:356] "Generic (PLEG): container finished" podID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerID="c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6" exitCode=0
Jul 29 00:41:03.741789 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.741758    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"
Jul 29 00:41:03.742019 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.741795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" event={"ID":"94a30d9e-134e-4cee-acb3-8e3aad121c35","Type":"ContainerDied","Data":"c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6"}
Jul 29 00:41:03.742019 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.741854    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph" event={"ID":"94a30d9e-134e-4cee-acb3-8e3aad121c35","Type":"ContainerDied","Data":"dc99b86dc3e8d6bb5ea72a6486f55d374ec9c0f2931315560c2299f2b07e754a"}
Jul 29 00:41:03.742019 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.741885    2559 scope.go:117] "RemoveContainer" containerID="c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6"
Jul 29 00:41:03.750648 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.750632    2559 scope.go:117] "RemoveContainer" containerID="c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2"
Jul 29 00:41:03.758580 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.758565    2559 scope.go:117] "RemoveContainer" containerID="c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6"
Jul 29 00:41:03.758846 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:41:03.758829    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6\": container with ID starting with c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6 not found: ID does not exist" containerID="c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6"
Jul 29 00:41:03.758908 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.758856    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6"} err="failed to get container status \"c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6\": rpc error: code = NotFound desc = could not find container \"c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6\": container with ID starting with c09b5da0992f5c843b5161760cf2fa7f81ab13939e3ddfc682ed391a4a1d86b6 not found: ID does not exist"
Jul 29 00:41:03.758908 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.758875    2559 scope.go:117] "RemoveContainer" containerID="c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2"
Jul 29 00:41:03.759116 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:41:03.759099    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2\": container with ID starting with c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2 not found: ID does not exist" containerID="c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2"
Jul 29 00:41:03.759161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.759124    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2"} err="failed to get container status \"c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2\": rpc error: code = NotFound desc = could not find container \"c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2\": container with ID starting with c47e8bac710d0160a821eab14acc29051cb00ab87943ee2bb791f34b4d192da2 not found: ID does not exist"
Jul 29 00:41:03.765363 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765344    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-data\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765452 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765378    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-envoy\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765452 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765424    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-credential-socket\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765452 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765447    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-socket\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765613 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765487    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a30d9e-134e-4cee-acb3-8e3aad121c35-istiod-ca-cert\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765613 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765535    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-certs\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765613 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765585    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-token\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765612    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-podinfo\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765647    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg28r\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-kube-api-access-hg28r\") pod \"94a30d9e-134e-4cee-acb3-8e3aad121c35\" (UID: \"94a30d9e-134e-4cee-acb3-8e3aad121c35\") "
Jul 29 00:41:03.765779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765724    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:03.765779 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765738    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:03.765986 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765930    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94a30d9e-134e-4cee-acb3-8e3aad121c35-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:41:03.766043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.765994    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:03.766043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.766015    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:03.766043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.766028    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94a30d9e-134e-4cee-acb3-8e3aad121c35-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:03.766182 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.766066    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:03.766378 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.766353    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-data" (OuterVolumeSpecName: "istio-data") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:03.767641 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.767612    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:41:03.767931 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.767912    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:41:03.768082 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.768058    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-kube-api-access-hg28r" (OuterVolumeSpecName: "kube-api-access-hg28r") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "kube-api-access-hg28r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:41:03.768082 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.768076    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-token" (OuterVolumeSpecName: "istio-token") pod "94a30d9e-134e-4cee-acb3-8e3aad121c35" (UID: "94a30d9e-134e-4cee-acb3-8e3aad121c35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:41:03.866492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.866461    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:03.866492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.866486    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:03.866709 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.866500    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg28r\" (UniqueName: \"kubernetes.io/projected/94a30d9e-134e-4cee-acb3-8e3aad121c35-kube-api-access-hg28r\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:03.866709 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.866516    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:03.866709 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.866524    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:03.866709 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:03.866532    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94a30d9e-134e-4cee-acb3-8e3aad121c35-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:41:04.064408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:04.064369    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"]
Jul 29 00:41:04.067134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:04.067109    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bce29f49-openshift-default-55585b947b-4hsph"]
Jul 29 00:41:04.496813 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:04.496782    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:04.597846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:04.597804    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:04.697858 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:04.697828    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:04.846836 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:04.846751    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:05.011025 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:05.010990    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" path="/var/lib/kubelet/pods/94a30d9e-134e-4cee-acb3-8e3aad121c35/volumes"
Jul 29 00:41:10.391575 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:10.391542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:10.464398 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:10.464366    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:17.288526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.288490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:17.572590 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.572512    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"]
Jul 29 00:41:17.572907 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.572890    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy"
Jul 29 00:41:17.572907 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.572906    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy"
Jul 29 00:41:17.573071 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.572931    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0455f1e5-a309-4a1f-923d-f962b282d8a7" containerName="revoke-keys"
Jul 29 00:41:17.573071 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.572940    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0455f1e5-a309-4a1f-923d-f962b282d8a7" containerName="revoke-keys"
Jul 29 00:41:17.573071 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.573008    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0455f1e5-a309-4a1f-923d-f962b282d8a7" containerName="revoke-keys"
Jul 29 00:41:17.573071 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.573020    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy"
Jul 29 00:41:17.577719 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.577698    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.580605 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.580582    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9d8ec5a2-openshift-default-dockercfg-89db6\""
Jul 29 00:41:17.587951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.587933    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"]
Jul 29 00:41:17.624163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.624135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:17.687341 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687305    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-credential-socket\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.687525 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-envoy\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.687525 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687419    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-certs\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.687525 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-token\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.687525 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-data\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.687525 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e000b228-76ee-4d4e-b346-3faf2fee7985-istiod-ca-cert\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.687776 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-socket\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.687776 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-podinfo\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.687776 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.687704    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnr9\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-kube-api-access-sxnr9\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.745404 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.745353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:17.789115 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-credential-socket\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789253 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-envoy\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789253 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-certs\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789253 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-token\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789430 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789294    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-data\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789430 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789335    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e000b228-76ee-4d4e-b346-3faf2fee7985-istiod-ca-cert\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789430 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-socket\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789430 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789392    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-podinfo\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789659 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnr9\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-kube-api-access-sxnr9\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789659 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789579    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-certs\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789727    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-credential-socket\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789751    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-data\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.789815 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.789780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-socket\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.790056 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.790039    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e000b228-76ee-4d4e-b346-3faf2fee7985-istiod-ca-cert\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.791640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.791620    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-envoy\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.791899 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.791883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-podinfo\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.797443 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.797424    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-token\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.797527 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.797501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnr9\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-kube-api-access-sxnr9\") pod \"e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") " pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:17.889513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:17.889485    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:18.030581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:18.030548    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"]
Jul 29 00:41:18.033212 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:41:18.033183    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode000b228_76ee_4d4e_b346_3faf2fee7985.slice/crio-6444f21949cea35a94b77c26a9bbf9f643d7145687c763d4d13a0c7630b61b98 WatchSource:0}: Error finding container 6444f21949cea35a94b77c26a9bbf9f643d7145687c763d4d13a0c7630b61b98: Status 404 returned error can't find the container with id 6444f21949cea35a94b77c26a9bbf9f643d7145687c763d4d13a0c7630b61b98
Jul 29 00:41:18.035485 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:18.035445    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:41:18.035564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:18.035528    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:41:18.035608 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:18.035571    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:41:18.819077 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:18.819038    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" event={"ID":"e000b228-76ee-4d4e-b346-3faf2fee7985","Type":"ContainerStarted","Data":"3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d"}
Jul 29 00:41:18.819465 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:18.819126    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" event={"ID":"e000b228-76ee-4d4e-b346-3faf2fee7985","Type":"ContainerStarted","Data":"6444f21949cea35a94b77c26a9bbf9f643d7145687c763d4d13a0c7630b61b98"}
Jul 29 00:41:18.840143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:18.840093    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" podStartSLOduration=1.8400798809999999 podStartE2EDuration="1.840079881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:41:18.837621737 +0000 UTC m=+2010.402074688" watchObservedRunningTime="2026-07-29 00:41:18.840079881 +0000 UTC m=+2010.404532832"
Jul 29 00:41:18.890493 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:18.890463    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:19.895426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:19.895396    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:20.732537 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:20.732467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:20.816942 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:20.816913    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:20.831066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:20.831032    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:20.832086 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:20.832063    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:20.886515 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:20.886483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:21.387863 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:21.387836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:21.635066 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:21.635037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:21.731555 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:21.731478    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:35.832898 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:35.832837    2559 patch_prober.go:28] interesting pod/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 29 00:41:35.833317 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:35.832922    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 29 00:41:35.925306 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:35.925268    2559 generic.go:356] "Generic (PLEG): container finished" podID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerID="3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d" exitCode=0
Jul 29 00:41:35.925479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:35.925339    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" event={"ID":"e000b228-76ee-4d4e-b346-3faf2fee7985","Type":"ContainerDied","Data":"3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d"}
Jul 29 00:41:35.925791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:35.925777    2559 scope.go:117] "RemoveContainer" containerID="3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d"
Jul 29 00:41:35.926797 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:35.926771    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:41:35.926859 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:35.926833    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:41:35.926900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:35.926865    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:41:36.933508 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:36.933470    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" event={"ID":"e000b228-76ee-4d4e-b346-3faf2fee7985","Type":"ContainerStarted","Data":"59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565"}
Jul 29 00:41:37.890223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:37.890184    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:37.890479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:37.890453    2559 patch_prober.go:28] interesting pod/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 29 00:41:37.890536 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:37.890517    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 29 00:41:38.890329 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:38.890294    2559 patch_prober.go:28] interesting pod/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 29 00:41:38.890754 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:38.890344    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 29 00:41:39.890388 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:39.890350    2559 patch_prober.go:28] interesting pod/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 29 00:41:39.890840 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:39.890407    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 29 00:41:40.893816 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:40.893784    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:40.894175 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:40.894133    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:40.894716 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:40.894700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:41:45.735123 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:45.735086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:50.008238 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.008196    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"]
Jul 29 00:41:50.008759 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.008739    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy"
Jul 29 00:41:50.008853 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.008760    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy"
Jul 29 00:41:50.008914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.008892    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="94a30d9e-134e-4cee-acb3-8e3aad121c35" containerName="istio-proxy"
Jul 29 00:41:50.013639 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.013614    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.016458 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.016427    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9d8ec5a2\"/\"kube-root-ca.crt\""
Jul 29 00:41:50.018426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.018217    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-9d8ec5a2\"/\"openshift-service-ca.crt\""
Jul 29 00:41:50.018543 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.018457    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9d8ec5a2\"/\"default-dockercfg-2m6vq\""
Jul 29 00:41:50.018543 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.018521    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-9d8ec5a2\"/\"e2e-lifecycle-model-9d8ec5a2-kserve-self-signed-certs\""
Jul 29 00:41:50.020775 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.020648    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"]
Jul 29 00:41:50.037682 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.037645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:41:50.051091 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.051063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-home\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.051214 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.051096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-tmp-dir\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.051214 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.051131    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-model-cache\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.051214 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.051157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnv9t\" (UniqueName: \"kubernetes.io/projected/ba9cdd99-2e89-4833-b657-e0b245c1f011-kube-api-access-cnv9t\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.051341 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.051315    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9cdd99-2e89-4833-b657-e0b245c1f011-tls-certs\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.051381 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.051360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-dshm\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.152820 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.152784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-tmp-dir\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.153004 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.152827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-model-cache\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.153004 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.152850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnv9t\" (UniqueName: \"kubernetes.io/projected/ba9cdd99-2e89-4833-b657-e0b245c1f011-kube-api-access-cnv9t\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.153004 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.152884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9cdd99-2e89-4833-b657-e0b245c1f011-tls-certs\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.153004 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.152917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-dshm\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.153004 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.152960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-home\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.153291 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.153265    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-model-cache\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.153356 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.153286    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-tmp-dir\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.153356 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.153318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-home\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.155339 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.155307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-dshm\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.155450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.155432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9cdd99-2e89-4833-b657-e0b245c1f011-tls-certs\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.160544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.160517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnv9t\" (UniqueName: \"kubernetes.io/projected/ba9cdd99-2e89-4833-b657-e0b245c1f011-kube-api-access-cnv9t\") pod \"e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") " pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.324923 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.324829    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:41:50.464500 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:50.464476    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"]
Jul 29 00:41:50.466570 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:41:50.466542    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba9cdd99_2e89_4833_b657_e0b245c1f011.slice/crio-8366da93bfd55b98b2cb95474296c29dee3f51eeb2025041055a787dbb336470 WatchSource:0}: Error finding container 8366da93bfd55b98b2cb95474296c29dee3f51eeb2025041055a787dbb336470: Status 404 returned error can't find the container with id 8366da93bfd55b98b2cb95474296c29dee3f51eeb2025041055a787dbb336470
Jul 29 00:41:51.010577 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:51.010541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b" event={"ID":"ba9cdd99-2e89-4833-b657-e0b245c1f011","Type":"ContainerStarted","Data":"0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734"}
Jul 29 00:41:51.010982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:51.010589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b" event={"ID":"ba9cdd99-2e89-4833-b657-e0b245c1f011","Type":"ContainerStarted","Data":"8366da93bfd55b98b2cb95474296c29dee3f51eeb2025041055a787dbb336470"}
Jul 29 00:41:51.024927 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:41:51.024882    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b" podStartSLOduration=2.024868714 podStartE2EDuration="2.024868714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:41:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:41:51.022425033 +0000 UTC m=+2042.586877984" watchObservedRunningTime="2026-07-29 00:41:51.024868714 +0000 UTC m=+2042.589321667"
Jul 29 00:42:00.325853 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:00.325819    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:42:00.326347 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:00.325914    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:42:00.338503 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:00.338482    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:42:01.068952 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:01.068920    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:42:14.896750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:14.896654    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"]
Jul 29 00:42:14.900126 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:14.900110    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"
Jul 29 00:42:14.902612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:14.902590    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:42:14.902806 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:14.902592    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:42:14.906766 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:14.906742    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"]
Jul 29 00:42:15.087083 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:15.087039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78907843-842e-4a55-be0b-6fc209d31b59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf\" (UID: \"78907843-842e-4a55-be0b-6fc209d31b59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"
Jul 29 00:42:15.187942 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:15.187854    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78907843-842e-4a55-be0b-6fc209d31b59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf\" (UID: \"78907843-842e-4a55-be0b-6fc209d31b59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"
Jul 29 00:42:15.188452 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:15.188432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78907843-842e-4a55-be0b-6fc209d31b59-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf\" (UID: \"78907843-842e-4a55-be0b-6fc209d31b59\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"
Jul 29 00:42:15.214036 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:15.214008    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"
Jul 29 00:42:15.349957 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:15.349890    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"]
Jul 29 00:42:15.352833 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:42:15.352804    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78907843_842e_4a55_be0b_6fc209d31b59.slice/crio-b81a52c0b52b166a2e00ea4a38e0e2d85c4c1e4d9f5c1d8d8e4a5e2b2b660d8d WatchSource:0}: Error finding container b81a52c0b52b166a2e00ea4a38e0e2d85c4c1e4d9f5c1d8d8e4a5e2b2b660d8d: Status 404 returned error can't find the container with id b81a52c0b52b166a2e00ea4a38e0e2d85c4c1e4d9f5c1d8d8e4a5e2b2b660d8d
Jul 29 00:42:16.139358 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:16.139325    2559 generic.go:356] "Generic (PLEG): container finished" podID="78907843-842e-4a55-be0b-6fc209d31b59" containerID="787a03ba56547f221e0d0734a6f4cc04289aac03f8d06b5182cc30919e984219" exitCode=0
Jul 29 00:42:16.139787 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:16.139380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf" event={"ID":"78907843-842e-4a55-be0b-6fc209d31b59","Type":"ContainerDied","Data":"787a03ba56547f221e0d0734a6f4cc04289aac03f8d06b5182cc30919e984219"}
Jul 29 00:42:16.139787 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:16.139429    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf" event={"ID":"78907843-842e-4a55-be0b-6fc209d31b59","Type":"ContainerStarted","Data":"b81a52c0b52b166a2e00ea4a38e0e2d85c4c1e4d9f5c1d8d8e4a5e2b2b660d8d"}
Jul 29 00:42:17.279602 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:17.279579    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"
Jul 29 00:42:17.304154 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:17.304127    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78907843-842e-4a55-be0b-6fc209d31b59-maas-api-service-ca\") pod \"78907843-842e-4a55-be0b-6fc209d31b59\" (UID: \"78907843-842e-4a55-be0b-6fc209d31b59\") "
Jul 29 00:42:17.304526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:17.304492    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78907843-842e-4a55-be0b-6fc209d31b59-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "78907843-842e-4a55-be0b-6fc209d31b59" (UID: "78907843-842e-4a55-be0b-6fc209d31b59"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:42:17.405798 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:17.405729    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/78907843-842e-4a55-be0b-6fc209d31b59-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:42:18.150936 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:18.150910    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"
Jul 29 00:42:18.151131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:18.150906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf" event={"ID":"78907843-842e-4a55-be0b-6fc209d31b59","Type":"ContainerDied","Data":"b81a52c0b52b166a2e00ea4a38e0e2d85c4c1e4d9f5c1d8d8e4a5e2b2b660d8d"}
Jul 29 00:42:18.151131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:18.151047    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b81a52c0b52b166a2e00ea4a38e0e2d85c4c1e4d9f5c1d8d8e4a5e2b2b660d8d"
Jul 29 00:42:24.833411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:24.833380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:42:24.933797 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:24.933750    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:42:24.994852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:24.994813    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"]
Jul 29 00:42:24.996697 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:24.996661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:42:24.996880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:24.996860    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9d8ec5a2-hzvqf"]
Jul 29 00:42:25.010753 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:25.010731    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78907843-842e-4a55-be0b-6fc209d31b59" path="/var/lib/kubelet/pods/78907843-842e-4a55-be0b-6fc209d31b59/volumes"
Jul 29 00:42:25.048048 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:25.048016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:42:28.181657 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:28.181621    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:42:33.267038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:33.267006    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"]
Jul 29 00:42:33.304997 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:33.304966    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:42:35.137459 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:35.137406    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:42:48.288250 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.288211    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b" podUID="ba9cdd99-2e89-4833-b657-e0b245c1f011" containerName="main" containerID="cri-o://0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734" gracePeriod=45
Jul 29 00:42:48.536734 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.536704    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:42:48.681522 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681496    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-tmp-dir\") pod \"ba9cdd99-2e89-4833-b657-e0b245c1f011\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") "
Jul 29 00:42:48.681726 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681533    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnv9t\" (UniqueName: \"kubernetes.io/projected/ba9cdd99-2e89-4833-b657-e0b245c1f011-kube-api-access-cnv9t\") pod \"ba9cdd99-2e89-4833-b657-e0b245c1f011\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") "
Jul 29 00:42:48.681726 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681567    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-home\") pod \"ba9cdd99-2e89-4833-b657-e0b245c1f011\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") "
Jul 29 00:42:48.681726 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681584    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9cdd99-2e89-4833-b657-e0b245c1f011-tls-certs\") pod \"ba9cdd99-2e89-4833-b657-e0b245c1f011\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") "
Jul 29 00:42:48.681726 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681607    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-model-cache\") pod \"ba9cdd99-2e89-4833-b657-e0b245c1f011\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") "
Jul 29 00:42:48.681726 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681638    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-dshm\") pod \"ba9cdd99-2e89-4833-b657-e0b245c1f011\" (UID: \"ba9cdd99-2e89-4833-b657-e0b245c1f011\") "
Jul 29 00:42:48.682013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681823    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ba9cdd99-2e89-4833-b657-e0b245c1f011" (UID: "ba9cdd99-2e89-4833-b657-e0b245c1f011"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:42:48.682013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681846    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-home" (OuterVolumeSpecName: "home") pod "ba9cdd99-2e89-4833-b657-e0b245c1f011" (UID: "ba9cdd99-2e89-4833-b657-e0b245c1f011"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:42:48.682013 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.681979    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-model-cache" (OuterVolumeSpecName: "model-cache") pod "ba9cdd99-2e89-4833-b657-e0b245c1f011" (UID: "ba9cdd99-2e89-4833-b657-e0b245c1f011"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:42:48.683889 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.683853    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-dshm" (OuterVolumeSpecName: "dshm") pod "ba9cdd99-2e89-4833-b657-e0b245c1f011" (UID: "ba9cdd99-2e89-4833-b657-e0b245c1f011"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:42:48.683995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.683930    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9cdd99-2e89-4833-b657-e0b245c1f011-kube-api-access-cnv9t" (OuterVolumeSpecName: "kube-api-access-cnv9t") pod "ba9cdd99-2e89-4833-b657-e0b245c1f011" (UID: "ba9cdd99-2e89-4833-b657-e0b245c1f011"). InnerVolumeSpecName "kube-api-access-cnv9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:42:48.683995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.683938    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba9cdd99-2e89-4833-b657-e0b245c1f011-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ba9cdd99-2e89-4833-b657-e0b245c1f011" (UID: "ba9cdd99-2e89-4833-b657-e0b245c1f011"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:42:48.783212 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.783185    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:42:48.783212 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.783209    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnv9t\" (UniqueName: \"kubernetes.io/projected/ba9cdd99-2e89-4833-b657-e0b245c1f011-kube-api-access-cnv9t\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:42:48.783366 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.783220    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:42:48.783366 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.783229    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba9cdd99-2e89-4833-b657-e0b245c1f011-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:42:48.783366 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.783237    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:42:48.783366 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:48.783244    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba9cdd99-2e89-4833-b657-e0b245c1f011-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:42:49.055643 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.055617    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:42:49.057896 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.057874    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:42:49.059493 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.059475    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:42:49.061826 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.061806    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:42:49.156576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.156552    2559 scope.go:117] "RemoveContainer" containerID="80b6828f8ca960308a90d36bf4aef144d56c46c9db4bbf32a5509eaa6872fe15"
Jul 29 00:42:49.317980 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.317888    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba9cdd99-2e89-4833-b657-e0b245c1f011" containerID="0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734" exitCode=0
Jul 29 00:42:49.317980 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.317948    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"
Jul 29 00:42:49.318454 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.317974    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b" event={"ID":"ba9cdd99-2e89-4833-b657-e0b245c1f011","Type":"ContainerDied","Data":"0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734"}
Jul 29 00:42:49.318454 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.318016    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b" event={"ID":"ba9cdd99-2e89-4833-b657-e0b245c1f011","Type":"ContainerDied","Data":"8366da93bfd55b98b2cb95474296c29dee3f51eeb2025041055a787dbb336470"}
Jul 29 00:42:49.318454 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.318042    2559 scope.go:117] "RemoveContainer" containerID="0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734"
Jul 29 00:42:49.327017 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.327002    2559 scope.go:117] "RemoveContainer" containerID="0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734"
Jul 29 00:42:49.327271 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:42:49.327245    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734\": container with ID starting with 0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734 not found: ID does not exist" containerID="0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734"
Jul 29 00:42:49.327320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.327282    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734"} err="failed to get container status \"0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734\": rpc error: code = NotFound desc = could not find container \"0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734\": container with ID starting with 0343bc44cb86725c7cd0448e6bfda6c73a432edfcab4bb7a7e5246578bd6f734 not found: ID does not exist"
Jul 29 00:42:49.334770 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.334745    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"]
Jul 29 00:42:49.336907 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:49.336886    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-9d8ec5a2/e2e-lifecycle-model-9d8ec5a2-kserve-96dd77d4c-zrx9b"]
Jul 29 00:42:51.011206 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:42:51.011162    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9cdd99-2e89-4833-b657-e0b245c1f011" path="/var/lib/kubelet/pods/ba9cdd99-2e89-4833-b657-e0b245c1f011/volumes"
Jul 29 00:43:09.413225 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:09.413194    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:10.714853 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:10.714816    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:15.806202 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:15.806172    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:15.870327 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:15.870286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:16.063622 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:16.063529    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"]
Jul 29 00:43:16.063851 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:16.063800    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy" containerID="cri-o://59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565" gracePeriod=30
Jul 29 00:43:16.084285 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:16.084259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:16.313543 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:16.313514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:17.354152 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:17.354099    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:17.453910 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:17.453862    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:17.563564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:17.563528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:18.291022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:18.290988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:18.392056 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:18.392030    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:18.492163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:18.492133    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:19.838068 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:19.838035    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:21.322707 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.322685    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:43:21.371106 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371078    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-certs\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371254 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371110    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-data\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371254 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371135    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxnr9\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-kube-api-access-sxnr9\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371254 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371197    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-credential-socket\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371254 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371214    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-podinfo\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371476 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371254    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e000b228-76ee-4d4e-b346-3faf2fee7985-istiod-ca-cert\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371476 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371305    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-envoy\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371476 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371398    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:43:21.371476 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371410    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-socket\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371476 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371472    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-token\") pod \"e000b228-76ee-4d4e-b346-3faf2fee7985\" (UID: \"e000b228-76ee-4d4e-b346-3faf2fee7985\") "
Jul 29 00:43:21.371765 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371568    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:43:21.371826 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371768    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.371826 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371787    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.371928 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371821    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e000b228-76ee-4d4e-b346-3faf2fee7985-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:43:21.371928 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.371828    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:43:21.372283 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.372257    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-data" (OuterVolumeSpecName: "istio-data") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:43:21.373776 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.373740    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:43:21.373887 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.373829    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-token" (OuterVolumeSpecName: "istio-token") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:43:21.374060 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.374036    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:43:21.374154 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.374055    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-kube-api-access-sxnr9" (OuterVolumeSpecName: "kube-api-access-sxnr9") pod "e000b228-76ee-4d4e-b346-3faf2fee7985" (UID: "e000b228-76ee-4d4e-b346-3faf2fee7985"). InnerVolumeSpecName "kube-api-access-sxnr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:43:21.473043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.473009    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.473043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.473045    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxnr9\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-kube-api-access-sxnr9\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.473232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.473060    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.473232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.473075    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e000b228-76ee-4d4e-b346-3faf2fee7985-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.473232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.473088    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.473232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.473099    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e000b228-76ee-4d4e-b346-3faf2fee7985-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.473232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.473111    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e000b228-76ee-4d4e-b346-3faf2fee7985-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:43:21.492474 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.492442    2559 generic.go:356] "Generic (PLEG): container finished" podID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerID="59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565" exitCode=0
Jul 29 00:43:21.492612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.492560    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"
Jul 29 00:43:21.492612 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.492590    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" event={"ID":"e000b228-76ee-4d4e-b346-3faf2fee7985","Type":"ContainerDied","Data":"59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565"}
Jul 29 00:43:21.492754 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.492647    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2" event={"ID":"e000b228-76ee-4d4e-b346-3faf2fee7985","Type":"ContainerDied","Data":"6444f21949cea35a94b77c26a9bbf9f643d7145687c763d4d13a0c7630b61b98"}
Jul 29 00:43:21.492754 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.492694    2559 scope.go:117] "RemoveContainer" containerID="59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565"
Jul 29 00:43:21.502229 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.502185    2559 scope.go:117] "RemoveContainer" containerID="3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d"
Jul 29 00:43:21.510434 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.510417    2559 scope.go:117] "RemoveContainer" containerID="59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565"
Jul 29 00:43:21.510694 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:43:21.510654    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565\": container with ID starting with 59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565 not found: ID does not exist" containerID="59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565"
Jul 29 00:43:21.510769 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.510707    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565"} err="failed to get container status \"59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565\": rpc error: code = NotFound desc = could not find container \"59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565\": container with ID starting with 59d383d06bec0fc27ed198344ac4d913733f760af8f83c3b618ff9b495d93565 not found: ID does not exist"
Jul 29 00:43:21.510769 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.510732    2559 scope.go:117] "RemoveContainer" containerID="3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d"
Jul 29 00:43:21.510997 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:43:21.510979    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d\": container with ID starting with 3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d not found: ID does not exist" containerID="3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d"
Jul 29 00:43:21.511043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.511003    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d"} err="failed to get container status \"3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d\": rpc error: code = NotFound desc = could not find container \"3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d\": container with ID starting with 3fcf2b6165e776846a9034cb8fdc31ebf399e758ea12a45e84d9d84b50805b1d not found: ID does not exist"
Jul 29 00:43:21.513791 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.513770    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"]
Jul 29 00:43:21.519623 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:21.519604    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9d8ec5a2-openshift-default-56bd48c6f6-t5mq2"]
Jul 29 00:43:23.010919 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:23.010892    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" path="/var/lib/kubelet/pods/e000b228-76ee-4d4e-b346-3faf2fee7985/volumes"
Jul 29 00:43:25.582073 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:25.582032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:25.683244 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:25.683207    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:26.255976 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:26.255936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:30.816441 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:30.816402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:32.000521 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:32.000475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:32.106987 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:32.106954    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:32.201309 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:32.201278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:42.732573 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:42.732474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:43.082496 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:43.082415    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:43:49.176624 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:49.176594    2559 scope.go:117] "RemoveContainer" containerID="19e14be9e61320517baa6b6725387422df9f9988ff34cb995423846aeaa6f40f"
Jul 29 00:43:49.185073 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:43:49.185055    2559 scope.go:117] "RemoveContainer" containerID="fc01f7882a55329db909fb3f073197b0e06be6e338270d318333255aea776241"
Jul 29 00:44:04.049615 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:04.049567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:10.121002 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.120967    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:10.221419 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.221386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:10.460419 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.460330    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:10.746085 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746014    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"]
Jul 29 00:44:10.746406 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746394    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9cdd99-2e89-4833-b657-e0b245c1f011" containerName="main"
Jul 29 00:44:10.746449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746407    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9cdd99-2e89-4833-b657-e0b245c1f011" containerName="main"
Jul 29 00:44:10.746449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746421    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78907843-842e-4a55-be0b-6fc209d31b59" containerName="revoke-keys"
Jul 29 00:44:10.746449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746426    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="78907843-842e-4a55-be0b-6fc209d31b59" containerName="revoke-keys"
Jul 29 00:44:10.746449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746434    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy"
Jul 29 00:44:10.746449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746439    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy"
Jul 29 00:44:10.746449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746447    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy"
Jul 29 00:44:10.746449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746452    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy"
Jul 29 00:44:10.746660 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746515    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="78907843-842e-4a55-be0b-6fc209d31b59" containerName="revoke-keys"
Jul 29 00:44:10.746660 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746524    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy"
Jul 29 00:44:10.746660 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.746531    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9cdd99-2e89-4833-b657-e0b245c1f011" containerName="main"
Jul 29 00:44:10.749494 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.749474    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.752187 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.752168    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-065b9c-openshift-default-dockercfg-z4c8z\""
Jul 29 00:44:10.764560 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.764527    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"]
Jul 29 00:44:10.765685 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.765645    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:10.781187 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781160    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-data\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.781301 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-certs\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.781301 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b846425-1550-494b-838f-3c4e218dd32e-istio-podinfo\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.781432 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781367    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b846425-1550-494b-838f-3c4e218dd32e-istiod-ca-cert\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.781432 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-istio-token\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.781529 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-socket\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.781575 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781554    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htnft\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-kube-api-access-htnft\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.781628 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-credential-socket\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.781701 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.781629    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-envoy\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-istio-token\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-socket\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnft\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-kube-api-access-htnft\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-credential-socket\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-envoy\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882407    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-data\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882460    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-certs\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882483    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b846425-1550-494b-838f-3c4e218dd32e-istio-podinfo\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b846425-1550-494b-838f-3c4e218dd32e-istiod-ca-cert\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-socket\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882728    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-credential-socket\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-certs\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.882891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.882851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-data\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.883223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.883152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b846425-1550-494b-838f-3c4e218dd32e-istiod-ca-cert\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.884623 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.884601    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-envoy\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.884961 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.884940    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b846425-1550-494b-838f-3c4e218dd32e-istio-podinfo\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.890205 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.890178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-istio-token\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:10.890476 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:10.890455    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htnft\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-kube-api-access-htnft\") pod \"e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") " pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:11.060152 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.060056    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:11.200305 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.200274    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"]
Jul 29 00:44:11.201821 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:44:11.201789    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b846425_1550_494b_838f_3c4e218dd32e.slice/crio-6b456621e51c567f33fc578c6372be1a0e1920cd1831b2649b935b3e71c3de4c WatchSource:0}: Error finding container 6b456621e51c567f33fc578c6372be1a0e1920cd1831b2649b935b3e71c3de4c: Status 404 returned error can't find the container with id 6b456621e51c567f33fc578c6372be1a0e1920cd1831b2649b935b3e71c3de4c
Jul 29 00:44:11.203985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.203954    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:11.204068 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.204022    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:11.204068 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.204050    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:11.254404 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.254378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:11.744078 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.744037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" event={"ID":"9b846425-1550-494b-838f-3c4e218dd32e","Type":"ContainerStarted","Data":"a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f"}
Jul 29 00:44:11.744256 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.744087    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" event={"ID":"9b846425-1550-494b-838f-3c4e218dd32e","Type":"ContainerStarted","Data":"6b456621e51c567f33fc578c6372be1a0e1920cd1831b2649b935b3e71c3de4c"}
Jul 29 00:44:11.765526 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:11.765479    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podStartSLOduration=1.765464616 podStartE2EDuration="1.765464616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:44:11.76312092 +0000 UTC m=+2183.327573871" watchObservedRunningTime="2026-07-29 00:44:11.765464616 +0000 UTC m=+2183.329917567"
Jul 29 00:44:12.060372 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:12.060284    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:12.061894 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:12.061867    2559 patch_prober.go:28] interesting pod/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 00:44:12.062031 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:12.061915    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 00:44:13.064941 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:13.064905    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:13.659383 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:13.659286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:13.752420 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:13.752378    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:13.755232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:13.755210    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:13.756087 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:13.756066    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:13.937715 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:13.937605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:14.395045 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:14.395013    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:14.536131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:14.536094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:14.629007 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:14.628975    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:27.829733 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:27.829699    2559 generic.go:356] "Generic (PLEG): container finished" podID="9b846425-1550-494b-838f-3c4e218dd32e" containerID="a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f" exitCode=0
Jul 29 00:44:27.830259 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:27.829769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" event={"ID":"9b846425-1550-494b-838f-3c4e218dd32e","Type":"ContainerDied","Data":"a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f"}
Jul 29 00:44:27.830334 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:27.830267    2559 scope.go:117] "RemoveContainer" containerID="a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f"
Jul 29 00:44:27.831353 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:27.831321    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:27.831454 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:27.831389    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:27.831454 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:27.831419    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:28.755476 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:28.755442    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:28.836063 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:28.836033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" event={"ID":"9b846425-1550-494b-838f-3c4e218dd32e","Type":"ContainerStarted","Data":"8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff"}
Jul 29 00:44:29.061263 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:29.061159    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:29.062401 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:29.062375    2559 patch_prober.go:28] interesting pod/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 00:44:29.062520 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:29.062428    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 00:44:30.060808 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:30.060760    2559 patch_prober.go:28] interesting pod/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 00:44:30.061343 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:30.060830    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 00:44:31.061280 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:31.061229    2559 patch_prober.go:28] interesting pod/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 00:44:31.061813 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:31.061302    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 00:44:32.061078 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:32.061038    2559 patch_prober.go:28] interesting pod/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 00:44:32.061400 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:32.061368    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 00:44:33.061528 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:33.061492    2559 patch_prober.go:28] interesting pod/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 29 00:44:33.062135 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:33.062104    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 29 00:44:34.064402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:34.064370    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:34.064854 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:34.064656    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:34.065416 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:34.065396    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:44:38.669256 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:38.669208    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:39.013571 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.013500    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:39.319782 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.319695    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"]
Jul 29 00:44:39.320401 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.320380    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e000b228-76ee-4d4e-b346-3faf2fee7985" containerName="istio-proxy"
Jul 29 00:44:39.323932 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.323913    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.326680 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.326641    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ad97f4-openshift-default-dockercfg-f2r9l\""
Jul 29 00:44:39.334400 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.334379    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"]
Jul 29 00:44:39.349297 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.349260    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:39.452355 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82136832-141f-4fa9-af8a-faf83e087292-istiod-ca-cert\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.452355 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-istio-token\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.452583 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrzc\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-kube-api-access-qsrzc\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.452583 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-socket\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.452583 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452486    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-credential-socket\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.452583 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82136832-141f-4fa9-af8a-faf83e087292-istio-podinfo\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.452583 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452570    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-data\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.452814 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452633    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-certs\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.452814 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.452658    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-envoy\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553135 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-certs\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-envoy\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82136832-141f-4fa9-af8a-faf83e087292-istiod-ca-cert\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-istio-token\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrzc\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-kube-api-access-qsrzc\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-socket\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-credential-socket\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82136832-141f-4fa9-af8a-faf83e087292-istio-podinfo\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-data\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-certs\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-socket\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553966 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553807    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-credential-socket\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.553966 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.553890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-data\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.554295 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.554274    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82136832-141f-4fa9-af8a-faf83e087292-istiod-ca-cert\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.555821 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.555799    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-envoy\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.556295 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.556274    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82136832-141f-4fa9-af8a-faf83e087292-istio-podinfo\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.561548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.561517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-istio-token\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.561631 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.561598    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrzc\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-kube-api-access-qsrzc\") pod \"e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") " pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.634768 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.634737    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:39.778482 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.778454    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"]
Jul 29 00:44:39.780164 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:44:39.780135    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82136832_141f_4fa9_af8a_faf83e087292.slice/crio-01e6c88b745cea7f7734a918f9e74c8049f963d1ed6255830890bb44023f6c3b WatchSource:0}: Error finding container 01e6c88b745cea7f7734a918f9e74c8049f963d1ed6255830890bb44023f6c3b: Status 404 returned error can't find the container with id 01e6c88b745cea7f7734a918f9e74c8049f963d1ed6255830890bb44023f6c3b
Jul 29 00:44:39.782236 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.782206    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:39.782324 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.782266    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:39.782324 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.782293    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:39.818710 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.818686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:39.892225 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.892125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" event={"ID":"82136832-141f-4fa9-af8a-faf83e087292","Type":"ContainerStarted","Data":"03153f0f08bed61f2e895b20272a6cdaeb1a321eca47904acb4b6776fac47c99"}
Jul 29 00:44:39.892225 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.892189    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" event={"ID":"82136832-141f-4fa9-af8a-faf83e087292","Type":"ContainerStarted","Data":"01e6c88b745cea7f7734a918f9e74c8049f963d1ed6255830890bb44023f6c3b"}
Jul 29 00:44:39.912640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:39.912581    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" podStartSLOduration=0.91255929 podStartE2EDuration="912.55929ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:44:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:44:39.910466774 +0000 UTC m=+2211.474919727" watchObservedRunningTime="2026-07-29 00:44:39.91255929 +0000 UTC m=+2211.477012243"
Jul 29 00:44:40.634955 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:40.634911    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:40.640024 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:40.640000    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:40.897467 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:40.897394    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:40.898243 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:40.898223    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:41.806957 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:41.806923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:41.895706 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:41.895657    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:41.955553 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:41.955522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:42.238035 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:42.238006    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:42.604029 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:42.603932    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:42.709143 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:42.709113    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:44:49.215740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:49.215686    2559 scope.go:117] "RemoveContainer" containerID="230545c2bab96259e4cf45b627034b6a78939ac36ccd758d876da94914c9fa23"
Jul 29 00:44:54.969594 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:54.969557    2559 generic.go:356] "Generic (PLEG): container finished" podID="82136832-141f-4fa9-af8a-faf83e087292" containerID="03153f0f08bed61f2e895b20272a6cdaeb1a321eca47904acb4b6776fac47c99" exitCode=0
Jul 29 00:44:54.970037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:54.969626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" event={"ID":"82136832-141f-4fa9-af8a-faf83e087292","Type":"ContainerDied","Data":"03153f0f08bed61f2e895b20272a6cdaeb1a321eca47904acb4b6776fac47c99"}
Jul 29 00:44:54.970037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:54.970032    2559 scope.go:117] "RemoveContainer" containerID="03153f0f08bed61f2e895b20272a6cdaeb1a321eca47904acb4b6776fac47c99"
Jul 29 00:44:54.971122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:54.971086    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:54.971234 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:54.971188    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:54.971302 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:54.971243    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:44:55.898018 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:55.897971    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:55.980560 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:55.980511    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" event={"ID":"82136832-141f-4fa9-af8a-faf83e087292","Type":"ContainerStarted","Data":"c67ccd59093e21ec8011b15731a4befe978bb22c7eaec8f30c5871f0d3f0735a"}
Jul 29 00:44:56.635858 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:56.635821    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:44:56.636917 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:56.636892    2559 patch_prober.go:28] interesting pod/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 29 00:44:56.637042 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:56.636956    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 29 00:44:57.635380 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:57.635342    2559 patch_prober.go:28] interesting pod/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 29 00:44:57.635806 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:57.635406    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 29 00:44:58.635825 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:58.635789    2559 patch_prober.go:28] interesting pod/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 29 00:44:58.636227 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:58.635855    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 29 00:44:59.635576 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:59.635535    2559 patch_prober.go:28] interesting pod/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 29 00:44:59.635816 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:44:59.635596    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 29 00:45:00.129287 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.129249    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls"]
Jul 29 00:45:00.133166 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.133149    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"]
Jul 29 00:45:00.133280 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.133262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls"
Jul 29 00:45:00.135831 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.135813    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:45:00.136587 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.136566    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"
Jul 29 00:45:00.139403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.139378    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"]
Jul 29 00:45:00.142761 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.142740    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls"]
Jul 29 00:45:00.146511 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.146493    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls"
Jul 29 00:45:00.154800 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.154780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"
Jul 29 00:45:00.303658 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.302746    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls"]
Jul 29 00:45:00.541721 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.541696    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"]
Jul 29 00:45:00.543483 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:45:00.543454    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65219af_5855_454b_be32_e244af90e3b0.slice/crio-dc93bc9b27f01f2b9b9f320ac426634b2c37dce047dd19e76584c2414f0c5027 WatchSource:0}: Error finding container dc93bc9b27f01f2b9b9f320ac426634b2c37dce047dd19e76584c2414f0c5027: Status 404 returned error can't find the container with id dc93bc9b27f01f2b9b9f320ac426634b2c37dce047dd19e76584c2414f0c5027
Jul 29 00:45:00.639246 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.639210    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:45:00.639527 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.639506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:45:00.640128 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:00.640111    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:45:01.011400 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:01.011333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf" event={"ID":"b65219af-5855-454b-be32-e244af90e3b0","Type":"ContainerStarted","Data":"04ca80c7f2f61b5f1df0780727d5eaf9a2deafa3e276731d4e36e7f77534e663"}
Jul 29 00:45:01.011400 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:01.011391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf" event={"ID":"b65219af-5855-454b-be32-e244af90e3b0","Type":"ContainerStarted","Data":"dc93bc9b27f01f2b9b9f320ac426634b2c37dce047dd19e76584c2414f0c5027"}
Jul 29 00:45:01.012845 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:01.012817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls" event={"ID":"2a45c688-33dc-4806-8179-f0b61d81162c","Type":"ContainerStarted","Data":"764562d33140d0d535ce3fc793179107982fc320f54c3df8d8ba070db0fa5427"}
Jul 29 00:45:01.012973 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:01.012866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls" event={"ID":"2a45c688-33dc-4806-8179-f0b61d81162c","Type":"ContainerStarted","Data":"f3a69fcd647615777b3ebb520682603f1df8778730d1dd8a50800aaf2d9579a7"}
Jul 29 00:45:01.026823 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:01.026778    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf" podStartSLOduration=1.026765608 podStartE2EDuration="1.026765608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:45:01.024859531 +0000 UTC m=+2232.589312482" watchObservedRunningTime="2026-07-29 00:45:01.026765608 +0000 UTC m=+2232.591218559"
Jul 29 00:45:01.039106 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:01.039036    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls" podStartSLOduration=1.039023184 podStartE2EDuration="1.039023184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:45:01.037563024 +0000 UTC m=+2232.602015976" watchObservedRunningTime="2026-07-29 00:45:01.039023184 +0000 UTC m=+2232.603476136"
Jul 29 00:45:02.020325 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:02.020178    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a45c688-33dc-4806-8179-f0b61d81162c" containerID="764562d33140d0d535ce3fc793179107982fc320f54c3df8d8ba070db0fa5427" exitCode=0
Jul 29 00:45:02.020325 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:02.020238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls" event={"ID":"2a45c688-33dc-4806-8179-f0b61d81162c","Type":"ContainerDied","Data":"764562d33140d0d535ce3fc793179107982fc320f54c3df8d8ba070db0fa5427"}
Jul 29 00:45:02.024991 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:02.024962    2559 generic.go:356] "Generic (PLEG): container finished" podID="b65219af-5855-454b-be32-e244af90e3b0" containerID="04ca80c7f2f61b5f1df0780727d5eaf9a2deafa3e276731d4e36e7f77534e663" exitCode=0
Jul 29 00:45:02.025213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:02.025060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf" event={"ID":"b65219af-5855-454b-be32-e244af90e3b0","Type":"ContainerDied","Data":"04ca80c7f2f61b5f1df0780727d5eaf9a2deafa3e276731d4e36e7f77534e663"}
Jul 29 00:45:03.170343 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:03.170317    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls"
Jul 29 00:45:03.209328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:03.209306    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"
Jul 29 00:45:04.035568 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:04.035539    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"
Jul 29 00:45:04.035747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:04.035575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf" event={"ID":"b65219af-5855-454b-be32-e244af90e3b0","Type":"ContainerDied","Data":"dc93bc9b27f01f2b9b9f320ac426634b2c37dce047dd19e76584c2414f0c5027"}
Jul 29 00:45:04.035747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:04.035620    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc93bc9b27f01f2b9b9f320ac426634b2c37dce047dd19e76584c2414f0c5027"
Jul 29 00:45:04.036910 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:04.036887    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls" event={"ID":"2a45c688-33dc-4806-8179-f0b61d81162c","Type":"ContainerDied","Data":"f3a69fcd647615777b3ebb520682603f1df8778730d1dd8a50800aaf2d9579a7"}
Jul 29 00:45:04.037049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:04.036915    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754765-97zls"
Jul 29 00:45:04.037049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:04.036927    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3a69fcd647615777b3ebb520682603f1df8778730d1dd8a50800aaf2d9579a7"
Jul 29 00:45:06.802043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:06.801997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:45:11.702492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.702412    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"]
Jul 29 00:45:11.702880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.702846    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65219af-5855-454b-be32-e244af90e3b0" containerName="cleanup"
Jul 29 00:45:11.702880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.702860    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65219af-5855-454b-be32-e244af90e3b0" containerName="cleanup"
Jul 29 00:45:11.702880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.702878    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a45c688-33dc-4806-8179-f0b61d81162c" containerName="cleanup"
Jul 29 00:45:11.702880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.702883    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a45c688-33dc-4806-8179-f0b61d81162c" containerName="cleanup"
Jul 29 00:45:11.703027 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.702940    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a45c688-33dc-4806-8179-f0b61d81162c" containerName="cleanup"
Jul 29 00:45:11.703027 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.702949    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65219af-5855-454b-be32-e244af90e3b0" containerName="cleanup"
Jul 29 00:45:11.706015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.705999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.708659 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.708635    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-065b9c\"/\"openshift-service-ca.crt\""
Jul 29 00:45:11.710054 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.710033    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-065b9c\"/\"kube-root-ca.crt\""
Jul 29 00:45:11.710176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.710082    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-065b9c\"/\"default-dockercfg-x7gkb\""
Jul 29 00:45:11.710176 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.710081    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-065b9c\"/\"test-model-065b9c-kserve-self-signed-certs\""
Jul 29 00:45:11.715305 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.715286    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"]
Jul 29 00:45:11.722793 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.722770    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:45:11.854223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.854190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-home\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.854223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.854226    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-dshm\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.854445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.854247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tmp-dir\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.854445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.854333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58zn9\" (UniqueName: \"kubernetes.io/projected/7ac6f4c7-74bd-4761-86e7-674caa333b8a-kube-api-access-58zn9\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.854445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.854390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-model-cache\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.854537 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.854447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.955529 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.955446    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58zn9\" (UniqueName: \"kubernetes.io/projected/7ac6f4c7-74bd-4761-86e7-674caa333b8a-kube-api-access-58zn9\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.955529 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.955498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-model-cache\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.955529 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.955524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.955874 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.955569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-home\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.955874 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.955589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-dshm\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.955874 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.955603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tmp-dir\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.956049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.955954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-model-cache\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.956049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.955980    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tmp-dir\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.956136 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.956059    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-home\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.958054 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.958034    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-dshm\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.958305 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.958287    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:11.965628 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:11.965605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58zn9\" (UniqueName: \"kubernetes.io/projected/7ac6f4c7-74bd-4761-86e7-674caa333b8a-kube-api-access-58zn9\") pod \"test-model-065b9c-kserve-76979bc44c-fqb2w\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") " pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:12.015727 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:12.015696    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:12.152420 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:12.152395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"]
Jul 29 00:45:12.154985 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:45:12.154960    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ac6f4c7_74bd_4761_86e7_674caa333b8a.slice/crio-d12bd322066dff260ffc7cd458ce9588e71ad94198abf518fa5ca4cd1141a287 WatchSource:0}: Error finding container d12bd322066dff260ffc7cd458ce9588e71ad94198abf518fa5ca4cd1141a287: Status 404 returned error can't find the container with id d12bd322066dff260ffc7cd458ce9588e71ad94198abf518fa5ca4cd1141a287
Jul 29 00:45:13.086139 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:13.086100    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w" event={"ID":"7ac6f4c7-74bd-4761-86e7-674caa333b8a","Type":"ContainerStarted","Data":"6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a"}
Jul 29 00:45:13.086713 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:13.086150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w" event={"ID":"7ac6f4c7-74bd-4761-86e7-674caa333b8a","Type":"ContainerStarted","Data":"d12bd322066dff260ffc7cd458ce9588e71ad94198abf518fa5ca4cd1141a287"}
Jul 29 00:45:13.104630 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:13.104582    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w" podStartSLOduration=2.104566579 podStartE2EDuration="2.104566579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:45:13.103743128 +0000 UTC m=+2244.668196080" watchObservedRunningTime="2026-07-29 00:45:13.104566579 +0000 UTC m=+2244.669019530"
Jul 29 00:45:22.016655 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:22.016595    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:22.017292 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:22.017259    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:22.031398 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:22.031356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:22.152407 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:22.152379    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:45:53.636499 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:53.636467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:45:59.915357 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:59.915323    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"]
Jul 29 00:45:59.919472 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:59.919439    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:45:59.923896 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:59.923871    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ad97f4\"/\"openshift-service-ca.crt\""
Jul 29 00:45:59.924048 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:59.923902    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ad97f4\"/\"test-model-ad97f4-kserve-self-signed-certs\""
Jul 29 00:45:59.924048 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:59.923871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ad97f4\"/\"default-dockercfg-8zmfw\""
Jul 29 00:45:59.924048 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:59.923871    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ad97f4\"/\"kube-root-ca.crt\""
Jul 29 00:45:59.927620 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:59.927587    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"]
Jul 29 00:45:59.943437 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:45:59.943413    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:00.090077 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.090027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tls-certs\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.090352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.090115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-dshm\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.090352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.090155    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-model-cache\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.090352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.090197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-home\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.090352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.090241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtg7g\" (UniqueName: \"kubernetes.io/projected/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-kube-api-access-dtg7g\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.090352 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.090292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tmp-dir\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.191445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.191358    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tls-certs\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.191445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.191397    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-dshm\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.191445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.191422    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-model-cache\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.191781 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.191552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-home\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.191781 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.191611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtg7g\" (UniqueName: \"kubernetes.io/projected/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-kube-api-access-dtg7g\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.191781 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.191655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tmp-dir\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.191941 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.191811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-model-cache\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.191941 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.191898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-home\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.192104 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.192077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tmp-dir\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.193964 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.193937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-dshm\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.194080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.194064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tls-certs\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.201084 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.201064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtg7g\" (UniqueName: \"kubernetes.io/projected/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-kube-api-access-dtg7g\") pod \"test-model-ad97f4-kserve-6b7b4c745f-8bgqh\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") " pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.230071 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.230045    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:00.366678 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:00.366639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"]
Jul 29 00:46:00.369449 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:46:00.369422    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55aafc2a_cf60_4d0a_8523_f1a9a3c6f3a0.slice/crio-b8cfd60baaaefd1a9c9d7be1e294c8542c296605291499f6882ed42b91f7db8f WatchSource:0}: Error finding container b8cfd60baaaefd1a9c9d7be1e294c8542c296605291499f6882ed42b91f7db8f: Status 404 returned error can't find the container with id b8cfd60baaaefd1a9c9d7be1e294c8542c296605291499f6882ed42b91f7db8f
Jul 29 00:46:01.347051 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:01.347019    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh" event={"ID":"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0","Type":"ContainerStarted","Data":"53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543"}
Jul 29 00:46:01.347465 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:01.347069    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh" event={"ID":"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0","Type":"ContainerStarted","Data":"b8cfd60baaaefd1a9c9d7be1e294c8542c296605291499f6882ed42b91f7db8f"}
Jul 29 00:46:01.365303 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:01.365242    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh" podStartSLOduration=2.365227723 podStartE2EDuration="2.365227723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:46:01.36386092 +0000 UTC m=+2292.928313872" watchObservedRunningTime="2026-07-29 00:46:01.365227723 +0000 UTC m=+2292.929680674"
Jul 29 00:46:10.230770 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:10.230735    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:10.231222 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:10.230785    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:10.243359 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:10.243333    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:10.404905 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:10.404875    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:42.051841 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:42.051747    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"]
Jul 29 00:46:42.069578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:42.069548    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:42.183374 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:42.183330    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-self-signed-certs: secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:42.183566 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:42.183427    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs podName:7ac6f4c7-74bd-4761-86e7-674caa333b8a nodeName:}" failed. No retries permitted until 2026-07-29 00:46:42.683407164 +0000 UTC m=+2334.247860094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs") pod "test-model-065b9c-kserve-76979bc44c-fqb2w" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a") : secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:42.687742 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:42.687708    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-self-signed-certs: secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:42.687920 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:42.687783    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs podName:7ac6f4c7-74bd-4761-86e7-674caa333b8a nodeName:}" failed. No retries permitted until 2026-07-29 00:46:43.687768922 +0000 UTC m=+2335.252221852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs") pod "test-model-065b9c-kserve-76979bc44c-fqb2w" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a") : secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:42.992231 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:42.992139    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"]
Jul 29 00:46:43.014894 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:43.014865    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:43.698521 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:43.698472    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-self-signed-certs: secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:43.698950 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:43.698570    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs podName:7ac6f4c7-74bd-4761-86e7-674caa333b8a nodeName:}" failed. No retries permitted until 2026-07-29 00:46:45.698548057 +0000 UTC m=+2337.263000986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs") pod "test-model-065b9c-kserve-76979bc44c-fqb2w" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a") : secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:45.719536 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:45.719503    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-self-signed-certs: secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:45.719946 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:45.719581    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs podName:7ac6f4c7-74bd-4761-86e7-674caa333b8a nodeName:}" failed. No retries permitted until 2026-07-29 00:46:49.719561195 +0000 UTC m=+2341.284014138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs") pod "test-model-065b9c-kserve-76979bc44c-fqb2w" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a") : secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:49.242472 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:49.242442    2559 scope.go:117] "RemoveContainer" containerID="b4b3a448b99a130786407a6fc306db373212c14a7b0847c3cbca4be1171a7318"
Jul 29 00:46:49.752770 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:49.752738    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-self-signed-certs: secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:49.752948 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:49.752824    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs podName:7ac6f4c7-74bd-4761-86e7-674caa333b8a nodeName:}" failed. No retries permitted until 2026-07-29 00:46:57.752809323 +0000 UTC m=+2349.317262253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs") pod "test-model-065b9c-kserve-76979bc44c-fqb2w" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a") : secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:53.661365 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:53.661332    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"]
Jul 29 00:46:53.664648 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:53.664620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:53.665401 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:53.665381    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-065b9c-29754765-dnfcf"]
Jul 29 00:46:53.724167 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:53.724136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:53.782038 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:53.782010    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:53.842354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:53.842321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:54.205321 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:54.205288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:55.011484 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:55.011452    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65219af-5855-454b-be32-e244af90e3b0" path="/var/lib/kubelet/pods/b65219af-5855-454b-be32-e244af90e3b0/volumes"
Jul 29 00:46:57.575423 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.575385    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w" podUID="7ac6f4c7-74bd-4761-86e7-674caa333b8a" containerName="main" containerID="cri-o://6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a" gracePeriod=45
Jul 29 00:46:57.825788 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:57.825726    2559 secret.go:189] Couldn't get secret ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-self-signed-certs: secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:57.825896 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:57.825792    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs podName:7ac6f4c7-74bd-4761-86e7-674caa333b8a nodeName:}" failed. No retries permitted until 2026-07-29 00:47:13.825776837 +0000 UTC m=+2365.390229766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs") pod "test-model-065b9c-kserve-76979bc44c-fqb2w" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a") : secret "test-model-065b9c-kserve-self-signed-certs" not found
Jul 29 00:46:57.832740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.832720    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:46:57.926413 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926381    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tmp-dir\") pod \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") "
Jul 29 00:46:57.926413 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926415    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-model-cache\") pod \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") "
Jul 29 00:46:57.926636 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926480    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-home\") pod \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") "
Jul 29 00:46:57.926636 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926527    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-dshm\") pod \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") "
Jul 29 00:46:57.926636 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926565    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58zn9\" (UniqueName: \"kubernetes.io/projected/7ac6f4c7-74bd-4761-86e7-674caa333b8a-kube-api-access-58zn9\") pod \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") "
Jul 29 00:46:57.926636 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs\") pod \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\" (UID: \"7ac6f4c7-74bd-4761-86e7-674caa333b8a\") "
Jul 29 00:46:57.926873 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926653    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7ac6f4c7-74bd-4761-86e7-674caa333b8a" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:46:57.926873 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926750    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-home" (OuterVolumeSpecName: "home") pod "7ac6f4c7-74bd-4761-86e7-674caa333b8a" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:46:57.926873 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926761    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-model-cache" (OuterVolumeSpecName: "model-cache") pod "7ac6f4c7-74bd-4761-86e7-674caa333b8a" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:46:57.927024 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926902    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:57.927024 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926923    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:57.927024 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.926937    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:57.928849 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.928815    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ac6f4c7-74bd-4761-86e7-674caa333b8a-kube-api-access-58zn9" (OuterVolumeSpecName: "kube-api-access-58zn9") pod "7ac6f4c7-74bd-4761-86e7-674caa333b8a" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a"). InnerVolumeSpecName "kube-api-access-58zn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:46:57.928849 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.928832    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7ac6f4c7-74bd-4761-86e7-674caa333b8a" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:46:57.928992 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:57.928894    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-dshm" (OuterVolumeSpecName: "dshm") pod "7ac6f4c7-74bd-4761-86e7-674caa333b8a" (UID: "7ac6f4c7-74bd-4761-86e7-674caa333b8a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:46:58.012200 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.012162    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh" podUID="55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" containerName="main" containerID="cri-o://53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543" gracePeriod=45
Jul 29 00:46:58.028015 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.027990    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ac6f4c7-74bd-4761-86e7-674caa333b8a-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.028125 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.028020    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58zn9\" (UniqueName: \"kubernetes.io/projected/7ac6f4c7-74bd-4761-86e7-674caa333b8a-kube-api-access-58zn9\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.028125 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.028035    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ac6f4c7-74bd-4761-86e7-674caa333b8a-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.260963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.260938    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:58.330400 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330374    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtg7g\" (UniqueName: \"kubernetes.io/projected/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-kube-api-access-dtg7g\") pod \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") "
Jul 29 00:46:58.330547 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330449    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tmp-dir\") pod \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") "
Jul 29 00:46:58.330547 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330528    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-home\") pod \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") "
Jul 29 00:46:58.330639 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330552    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tls-certs\") pod \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") "
Jul 29 00:46:58.330639 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-dshm\") pod \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") "
Jul 29 00:46:58.330776 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330639    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-model-cache\") pod \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\" (UID: \"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0\") "
Jul 29 00:46:58.330840 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330764    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" (UID: "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:46:58.330840 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330794    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-home" (OuterVolumeSpecName: "home") pod "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" (UID: "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:46:58.330976 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330953    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" (UID: "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:46:58.331144 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330975    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.331144 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.330996    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.332800 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.332779    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-dshm" (OuterVolumeSpecName: "dshm") pod "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" (UID: "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:46:58.332879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.332844    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" (UID: "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:46:58.332879 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.332860    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-kube-api-access-dtg7g" (OuterVolumeSpecName: "kube-api-access-dtg7g") pod "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" (UID: "55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0"). InnerVolumeSpecName "kube-api-access-dtg7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:46:58.432354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.432287    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtg7g\" (UniqueName: \"kubernetes.io/projected/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-kube-api-access-dtg7g\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.432354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.432311    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.432354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.432322    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.432354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.432330    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:46:58.638037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.638004    2559 generic.go:356] "Generic (PLEG): container finished" podID="55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" containerID="53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543" exitCode=0
Jul 29 00:46:58.638427 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.638060    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"
Jul 29 00:46:58.638427 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.638094    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh" event={"ID":"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0","Type":"ContainerDied","Data":"53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543"}
Jul 29 00:46:58.638427 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.638133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh" event={"ID":"55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0","Type":"ContainerDied","Data":"b8cfd60baaaefd1a9c9d7be1e294c8542c296605291499f6882ed42b91f7db8f"}
Jul 29 00:46:58.638427 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.638155    2559 scope.go:117] "RemoveContainer" containerID="53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543"
Jul 29 00:46:58.639600 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.639508    2559 generic.go:356] "Generic (PLEG): container finished" podID="7ac6f4c7-74bd-4761-86e7-674caa333b8a" containerID="6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a" exitCode=0
Jul 29 00:46:58.639600 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.639552    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"
Jul 29 00:46:58.639600 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.639589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w" event={"ID":"7ac6f4c7-74bd-4761-86e7-674caa333b8a","Type":"ContainerDied","Data":"6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a"}
Jul 29 00:46:58.639755 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.639629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w" event={"ID":"7ac6f4c7-74bd-4761-86e7-674caa333b8a","Type":"ContainerDied","Data":"d12bd322066dff260ffc7cd458ce9588e71ad94198abf518fa5ca4cd1141a287"}
Jul 29 00:46:58.648511 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.648494    2559 scope.go:117] "RemoveContainer" containerID="53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543"
Jul 29 00:46:58.648777 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:58.648756    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543\": container with ID starting with 53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543 not found: ID does not exist" containerID="53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543"
Jul 29 00:46:58.648827 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.648790    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543"} err="failed to get container status \"53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543\": rpc error: code = NotFound desc = could not find container \"53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543\": container with ID starting with 53c992c0c1ccc219a93543b65c4dacfc2b06ee1081693c58b3160629b472b543 not found: ID does not exist"
Jul 29 00:46:58.648827 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.648812    2559 scope.go:117] "RemoveContainer" containerID="6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a"
Jul 29 00:46:58.657088 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.657071    2559 scope.go:117] "RemoveContainer" containerID="6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a"
Jul 29 00:46:58.657333 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:46:58.657314    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a\": container with ID starting with 6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a not found: ID does not exist" containerID="6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a"
Jul 29 00:46:58.657387 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.657339    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a"} err="failed to get container status \"6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a\": rpc error: code = NotFound desc = could not find container \"6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a\": container with ID starting with 6c66b348cc23a8c244d02775cad7fc4b49d36e56fd9a98fa702101769692054a not found: ID does not exist"
Jul 29 00:46:58.663751 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.663727    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"]
Jul 29 00:46:58.665691 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.665637    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-065b9c/test-model-065b9c-kserve-76979bc44c-fqb2w"]
Jul 29 00:46:58.674590 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.674444    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"]
Jul 29 00:46:58.676341 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:58.676319    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ad97f4/test-model-ad97f4-kserve-6b7b4c745f-8bgqh"]
Jul 29 00:46:59.010622 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:59.010589    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" path="/var/lib/kubelet/pods/55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0/volumes"
Jul 29 00:46:59.010997 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:59.010983    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ac6f4c7-74bd-4761-86e7-674caa333b8a" path="/var/lib/kubelet/pods/7ac6f4c7-74bd-4761-86e7-674caa333b8a/volumes"
Jul 29 00:46:59.927374 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:59.927324    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:46:59.988994 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:46:59.988966    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:00.174391 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.174358    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"]
Jul 29 00:47:00.174635 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.174606    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy" containerID="cri-o://8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff" gracePeriod=30
Jul 29 00:47:00.194487 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.194406    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:00.433880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.433843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:00.547911 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.547823    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"]
Jul 29 00:47:00.548208 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.548196    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" containerName="main"
Jul 29 00:47:00.548262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.548209    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" containerName="main"
Jul 29 00:47:00.548262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.548221    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ac6f4c7-74bd-4761-86e7-674caa333b8a" containerName="main"
Jul 29 00:47:00.548262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.548226    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ac6f4c7-74bd-4761-86e7-674caa333b8a" containerName="main"
Jul 29 00:47:00.548376 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.548280    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="55aafc2a-cf60-4d0a-8523-f1a9a3c6f3a0" containerName="main"
Jul 29 00:47:00.548376 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.548290    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ac6f4c7-74bd-4761-86e7-674caa333b8a" containerName="main"
Jul 29 00:47:00.552653 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.552629    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"
Jul 29 00:47:00.555523 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.555489    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:47:00.555652 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.555555    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:47:00.557624 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.557575    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"]
Jul 29 00:47:00.650601 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.650572    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba4bedf-5230-4679-a3b2-2d987f0bcb9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl\" (UID: \"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"
Jul 29 00:47:00.752091 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.752042    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba4bedf-5230-4679-a3b2-2d987f0bcb9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl\" (UID: \"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"
Jul 29 00:47:00.752726 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.752706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba4bedf-5230-4679-a3b2-2d987f0bcb9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl\" (UID: \"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"
Jul 29 00:47:00.865977 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:00.865888    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"
Jul 29 00:47:01.010464 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:47:01.010435    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba4bedf_5230_4679_a3b2_2d987f0bcb9b.slice/crio-e65c4fac243d3a89892a9b1bf2150c3e04b8d9f8a1fc865e56b7b5c535b487af WatchSource:0}: Error finding container e65c4fac243d3a89892a9b1bf2150c3e04b8d9f8a1fc865e56b7b5c535b487af: Status 404 returned error can't find the container with id e65c4fac243d3a89892a9b1bf2150c3e04b8d9f8a1fc865e56b7b5c535b487af
Jul 29 00:47:01.014101 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:01.014077    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"]
Jul 29 00:47:01.658618 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:01.658576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl" event={"ID":"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b","Type":"ContainerStarted","Data":"3dc4489324db010462bd72fa3d0384b062603ffde0bcfaee1cf30603270291d2"}
Jul 29 00:47:01.658864 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:01.658699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl" event={"ID":"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b","Type":"ContainerStarted","Data":"e65c4fac243d3a89892a9b1bf2150c3e04b8d9f8a1fc865e56b7b5c535b487af"}
Jul 29 00:47:01.673720 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:01.673652    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl" podStartSLOduration=1.673635832 podStartE2EDuration="1.673635832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:47:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:47:01.672328773 +0000 UTC m=+2353.236781727" watchObservedRunningTime="2026-07-29 00:47:01.673635832 +0000 UTC m=+2353.238088786"
Jul 29 00:47:02.667479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:02.667443    2559 generic.go:356] "Generic (PLEG): container finished" podID="6ba4bedf-5230-4679-a3b2-2d987f0bcb9b" containerID="3dc4489324db010462bd72fa3d0384b062603ffde0bcfaee1cf30603270291d2" exitCode=0
Jul 29 00:47:02.667982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:02.667529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl" event={"ID":"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b","Type":"ContainerDied","Data":"3dc4489324db010462bd72fa3d0384b062603ffde0bcfaee1cf30603270291d2"}
Jul 29 00:47:03.811427 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:03.811400    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"
Jul 29 00:47:03.884611 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:03.884583    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba4bedf-5230-4679-a3b2-2d987f0bcb9b-maas-api-service-ca\") pod \"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b\" (UID: \"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b\") "
Jul 29 00:47:03.884966 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:03.884942    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ba4bedf-5230-4679-a3b2-2d987f0bcb9b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ba4bedf-5230-4679-a3b2-2d987f0bcb9b" (UID: "6ba4bedf-5230-4679-a3b2-2d987f0bcb9b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:47:03.985618 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:03.985531    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ba4bedf-5230-4679-a3b2-2d987f0bcb9b-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:04.067097 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:04.067060    2559 patch_prober.go:28] interesting pod/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 00:47:04.067263 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:04.067124    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 00:47:04.680443 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:04.680416    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"
Jul 29 00:47:04.680443 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:04.680422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl" event={"ID":"6ba4bedf-5230-4679-a3b2-2d987f0bcb9b","Type":"ContainerDied","Data":"e65c4fac243d3a89892a9b1bf2150c3e04b8d9f8a1fc865e56b7b5c535b487af"}
Jul 29 00:47:04.680683 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:04.680467    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e65c4fac243d3a89892a9b1bf2150c3e04b8d9f8a1fc865e56b7b5c535b487af"
Jul 29 00:47:05.438145 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.438082    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:47:05.501510 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501470    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b846425-1550-494b-838f-3c4e218dd32e-istio-podinfo\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.501737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501518    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b846425-1550-494b-838f-3c4e218dd32e-istiod-ca-cert\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.501737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501548    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-certs\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.501737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501584    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-socket\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.501737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501626    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-data\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.501737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501659    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-credential-socket\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.501737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501720    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-envoy\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.502059 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501788    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-istio-token\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.502059 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htnft\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-kube-api-access-htnft\") pod \"9b846425-1550-494b-838f-3c4e218dd32e\" (UID: \"9b846425-1550-494b-838f-3c4e218dd32e\") "
Jul 29 00:47:05.502059 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.501932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:05.502059 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.502001    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:05.502276 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.502071    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b846425-1550-494b-838f-3c4e218dd32e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:47:05.502276 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.502193    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b846425-1550-494b-838f-3c4e218dd32e-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.502276 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.502268    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.502500 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.502276    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:05.502500 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.502285    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.502792 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.502531    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:05.503915 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.503891    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b846425-1550-494b-838f-3c4e218dd32e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:47:05.504234 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.504207    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:05.504234 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.504220    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-kube-api-access-htnft" (OuterVolumeSpecName: "kube-api-access-htnft") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "kube-api-access-htnft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:47:05.504362 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.504244    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b846425-1550-494b-838f-3c4e218dd32e" (UID: "9b846425-1550-494b-838f-3c4e218dd32e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:47:05.603100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.603061    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b846425-1550-494b-838f-3c4e218dd32e-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.603100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.603093    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.603100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.603101    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.603100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.603109    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b846425-1550-494b-838f-3c4e218dd32e-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.603379 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.603118    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.603379 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.603126    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htnft\" (UniqueName: \"kubernetes.io/projected/9b846425-1550-494b-838f-3c4e218dd32e-kube-api-access-htnft\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:05.687039 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.687004    2559 generic.go:356] "Generic (PLEG): container finished" podID="9b846425-1550-494b-838f-3c4e218dd32e" containerID="8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff" exitCode=0
Jul 29 00:47:05.687244 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.687068    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"
Jul 29 00:47:05.687244 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.687092    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" event={"ID":"9b846425-1550-494b-838f-3c4e218dd32e","Type":"ContainerDied","Data":"8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff"}
Jul 29 00:47:05.687244 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.687143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs" event={"ID":"9b846425-1550-494b-838f-3c4e218dd32e","Type":"ContainerDied","Data":"6b456621e51c567f33fc578c6372be1a0e1920cd1831b2649b935b3e71c3de4c"}
Jul 29 00:47:05.687244 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.687168    2559 scope.go:117] "RemoveContainer" containerID="8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff"
Jul 29 00:47:05.698227 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.698208    2559 scope.go:117] "RemoveContainer" containerID="a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f"
Jul 29 00:47:05.707901 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.707881    2559 scope.go:117] "RemoveContainer" containerID="8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff"
Jul 29 00:47:05.708297 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:47:05.708270    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff\": container with ID starting with 8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff not found: ID does not exist" containerID="8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff"
Jul 29 00:47:05.708395 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.708307    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff"} err="failed to get container status \"8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff\": rpc error: code = NotFound desc = could not find container \"8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff\": container with ID starting with 8f6b8cd75247a767f2d8cf677b1a9adf5f1cde700be5e5fd18893d054a582cff not found: ID does not exist"
Jul 29 00:47:05.708395 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.708332    2559 scope.go:117] "RemoveContainer" containerID="a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f"
Jul 29 00:47:05.708650 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:47:05.708628    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f\": container with ID starting with a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f not found: ID does not exist" containerID="a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f"
Jul 29 00:47:05.708746 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.708662    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f"} err="failed to get container status \"a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f\": rpc error: code = NotFound desc = could not find container \"a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f\": container with ID starting with a77f2d7cbf8b1e74b344e9adfe1ebd81bcc9d8e7221b9667adb0f14117c3637f not found: ID does not exist"
Jul 29 00:47:05.711151 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.711127    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"]
Jul 29 00:47:05.713984 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:05.713955    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-065b9c-openshift-default-696fcdc9fb-g44xs"]
Jul 29 00:47:07.011489 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:07.011455    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b846425-1550-494b-838f-3c4e218dd32e" path="/var/lib/kubelet/pods/9b846425-1550-494b-838f-3c4e218dd32e/volumes"
Jul 29 00:47:11.027724 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:11.027656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:11.128247 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:11.128202    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:11.187059 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:11.187023    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"]
Jul 29 00:47:11.189359 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:11.189338    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ad97f4-dxtjl"]
Jul 29 00:47:11.196957 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:11.196936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:11.552866 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:11.552822    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:13.011441 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:13.011410    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ba4bedf-5230-4679-a3b2-2d987f0bcb9b" path="/var/lib/kubelet/pods/6ba4bedf-5230-4679-a3b2-2d987f0bcb9b/volumes"
Jul 29 00:47:17.322360 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:17.322323    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:17.422233 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:17.422190    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:17.573163 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:17.573075    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"]
Jul 29 00:47:17.573345 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:17.573322    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy" containerID="cri-o://c67ccd59093e21ec8011b15731a4befe978bb22c7eaec8f30c5871f0d3f0735a" gracePeriod=30
Jul 29 00:47:17.596955 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:17.596931    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:17.823322 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:17.823231    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:18.168871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.168825    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:18.585809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.585732    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"]
Jul 29 00:47:18.586131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586115    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy"
Jul 29 00:47:18.586131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586126    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy"
Jul 29 00:47:18.586213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586134    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba4bedf-5230-4679-a3b2-2d987f0bcb9b" containerName="revoke-keys"
Jul 29 00:47:18.586213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586139    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba4bedf-5230-4679-a3b2-2d987f0bcb9b" containerName="revoke-keys"
Jul 29 00:47:18.586213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586153    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy"
Jul 29 00:47:18.586213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586158    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy"
Jul 29 00:47:18.586213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586214    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba4bedf-5230-4679-a3b2-2d987f0bcb9b" containerName="revoke-keys"
Jul 29 00:47:18.586371 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586222    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy"
Jul 29 00:47:18.586371 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.586230    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b846425-1550-494b-838f-3c4e218dd32e" containerName="istio-proxy"
Jul 29 00:47:18.590871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.590852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.595109 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.595091    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4f3846-openshift-default-dockercfg-n4z5b\""
Jul 29 00:47:18.610694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.610655    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"]
Jul 29 00:47:18.621436 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.621413    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:18.724963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.724924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-token\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.724963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.724962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istiod-ca-cert\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.725137 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.724988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-envoy\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.725137 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.725060    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l8fb\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-kube-api-access-5l8fb\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.725137 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.725104    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-data\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.725137 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.725122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-podinfo\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.725283 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.725204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-socket\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.725283 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.725222    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-credential-socket\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.725283 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.725243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-certs\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-socket\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825767 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-credential-socket\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-certs\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-token\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istiod-ca-cert\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-envoy\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l8fb\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-kube-api-access-5l8fb\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-data\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.825995 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.825941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-podinfo\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.826248 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.826173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-socket\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.826248 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.826228    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-certs\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.826337 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.826314    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-data\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.826505 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.826485    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-credential-socket\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.826790 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.826771    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istiod-ca-cert\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.828196 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.828173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-envoy\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.828570 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.828553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-podinfo\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.833759 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.833733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-token\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.833963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.833943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l8fb\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-kube-api-access-5l8fb\") pod \"e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") " pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.900570 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.900547    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:18.909450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:18.909421    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:19.040841 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:19.040819    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"]
Jul 29 00:47:19.042607 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:47:19.042577    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fbeb1b0_6322_42ba_938f_08cf95b0b858.slice/crio-0cbd39475528c135346d7462f9bbcad8f16b98f7e6f790b61489ce0cb7c63dde WatchSource:0}: Error finding container 0cbd39475528c135346d7462f9bbcad8f16b98f7e6f790b61489ce0cb7c63dde: Status 404 returned error can't find the container with id 0cbd39475528c135346d7462f9bbcad8f16b98f7e6f790b61489ce0cb7c63dde
Jul 29 00:47:19.044881 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:19.044844    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:19.044970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:19.044934    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:19.045014 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:19.044979    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:19.764937 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:19.764897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" event={"ID":"8fbeb1b0-6322-42ba-938f-08cf95b0b858","Type":"ContainerStarted","Data":"d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025"}
Jul 29 00:47:19.765370 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:19.764949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" event={"ID":"8fbeb1b0-6322-42ba-938f-08cf95b0b858","Type":"ContainerStarted","Data":"0cbd39475528c135346d7462f9bbcad8f16b98f7e6f790b61489ce0cb7c63dde"}
Jul 29 00:47:19.799492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:19.799445    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" podStartSLOduration=1.799429805 podStartE2EDuration="1.799429805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:47:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:47:19.798907066 +0000 UTC m=+2371.363360013" watchObservedRunningTime="2026-07-29 00:47:19.799429805 +0000 UTC m=+2371.363882756"
Jul 29 00:47:19.901738 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:19.901707    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:20.906544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:20.906512    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:21.747809 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:21.747776    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:21.783236 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:21.783203    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:21.784297 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:21.784271    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:21.840415 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:21.840380    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:21.943335 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:21.943302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:22.148267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.148232    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:22.544396 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.544319    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:22.639386 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.639357    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:22.792105 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.792078    2559 generic.go:356] "Generic (PLEG): container finished" podID="82136832-141f-4fa9-af8a-faf83e087292" containerID="c67ccd59093e21ec8011b15731a4befe978bb22c7eaec8f30c5871f0d3f0735a" exitCode=0
Jul 29 00:47:22.792249 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.792150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" event={"ID":"82136832-141f-4fa9-af8a-faf83e087292","Type":"ContainerDied","Data":"c67ccd59093e21ec8011b15731a4befe978bb22c7eaec8f30c5871f0d3f0735a"}
Jul 29 00:47:22.792249 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.792217    2559 scope.go:117] "RemoveContainer" containerID="03153f0f08bed61f2e895b20272a6cdaeb1a321eca47904acb4b6776fac47c99"
Jul 29 00:47:22.832284 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.832263    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:47:22.967718 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.967658    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-istio-token\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.967726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-socket\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.967759    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-envoy\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.967790    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-certs\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.967847    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82136832-141f-4fa9-af8a-faf83e087292-istiod-ca-cert\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.967910    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsrzc\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-kube-api-access-qsrzc\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.967953    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-data\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.968036    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:22.968160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.967990    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-credential-socket\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968577 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.968181    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82136832-141f-4fa9-af8a-faf83e087292-istio-podinfo\") pod \"82136832-141f-4fa9-af8a-faf83e087292\" (UID: \"82136832-141f-4fa9-af8a-faf83e087292\") "
Jul 29 00:47:22.968577 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.968298    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:22.968577 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.968363    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:22.968772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.968622    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:22.968772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.968641    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:22.968772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.968657    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:22.968939 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.968793    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-data" (OuterVolumeSpecName: "istio-data") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:22.969326 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.969296    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82136832-141f-4fa9-af8a-faf83e087292-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:47:22.970384 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.970356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-istio-token" (OuterVolumeSpecName: "istio-token") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:47:22.970489 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.970472    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82136832-141f-4fa9-af8a-faf83e087292-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:47:22.970560 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.970505    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:47:22.970910 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:22.970891    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-kube-api-access-qsrzc" (OuterVolumeSpecName: "kube-api-access-qsrzc") pod "82136832-141f-4fa9-af8a-faf83e087292" (UID: "82136832-141f-4fa9-af8a-faf83e087292"). InnerVolumeSpecName "kube-api-access-qsrzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:47:23.069785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.069691    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82136832-141f-4fa9-af8a-faf83e087292-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:23.069785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.069719    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsrzc\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-kube-api-access-qsrzc\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:23.069785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.069730    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:23.069785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.069739    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82136832-141f-4fa9-af8a-faf83e087292-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:23.069785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.069747    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82136832-141f-4fa9-af8a-faf83e087292-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:23.069785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.069756    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82136832-141f-4fa9-af8a-faf83e087292-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:47:23.798326 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.798296    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"
Jul 29 00:47:23.798326 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.798327    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk" event={"ID":"82136832-141f-4fa9-af8a-faf83e087292","Type":"ContainerDied","Data":"01e6c88b745cea7f7734a918f9e74c8049f963d1ed6255830890bb44023f6c3b"}
Jul 29 00:47:23.798579 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.798379    2559 scope.go:117] "RemoveContainer" containerID="c67ccd59093e21ec8011b15731a4befe978bb22c7eaec8f30c5871f0d3f0735a"
Jul 29 00:47:23.819304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.819278    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"]
Jul 29 00:47:23.823171 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:23.823143    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ad97f4-openshift-default-595f45c4-c6pfk"]
Jul 29 00:47:25.011590 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:25.011558    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82136832-141f-4fa9-af8a-faf83e087292" path="/var/lib/kubelet/pods/82136832-141f-4fa9-af8a-faf83e087292/volumes"
Jul 29 00:47:29.332491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:29.332453    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:36.785188 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:36.785158    2559 patch_prober.go:28] interesting pod/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 29 00:47:36.785560 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:36.785219    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 29 00:47:36.875522 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:36.875487    2559 generic.go:356] "Generic (PLEG): container finished" podID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerID="d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025" exitCode=0
Jul 29 00:47:36.875691 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:36.875570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" event={"ID":"8fbeb1b0-6322-42ba-938f-08cf95b0b858","Type":"ContainerDied","Data":"d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025"}
Jul 29 00:47:36.875982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:36.875967    2559 scope.go:117] "RemoveContainer" containerID="d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025"
Jul 29 00:47:36.877034 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:36.877008    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:36.877092 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:36.877080    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:36.877131 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:36.877119    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:37.887740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:37.887701    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" event={"ID":"8fbeb1b0-6322-42ba-938f-08cf95b0b858","Type":"ContainerStarted","Data":"b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444"}
Jul 29 00:47:37.901226 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:37.901196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:37.901373 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:37.901353    2559 patch_prober.go:28] interesting pod/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 29 00:47:37.901417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:37.901403    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 29 00:47:38.901507 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:38.901471    2559 patch_prober.go:28] interesting pod/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 29 00:47:38.902002 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:38.901530    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 29 00:47:39.901497 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:39.901466    2559 patch_prober.go:28] interesting pod/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 29 00:47:39.901713 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:39.901520    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 29 00:47:40.901162 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:40.901131    2559 patch_prober.go:28] interesting pod/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Jul 29 00:47:40.901362 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:40.901185    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Jul 29 00:47:41.905177 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:41.905131    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:41.905640 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:41.905463    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:41.906287 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:41.906265    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:47:46.778505 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:46.778472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:47.271887 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.271855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:47.536700 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.536602    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"]
Jul 29 00:47:47.537022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.537007    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy"
Jul 29 00:47:47.537080 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.537025    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy"
Jul 29 00:47:47.537120 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.537098    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy"
Jul 29 00:47:47.537120 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.537107    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy"
Jul 29 00:47:47.540558 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.540538    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.543834 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.543816    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-111f37-openshift-default-dockercfg-ztxt6\""
Jul 29 00:47:47.556436 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.556395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"]
Jul 29 00:47:47.580121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.580089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:47.599323 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599290    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-podinfo\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.599464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-envoy\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.599464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-credential-socket\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.599464 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-data\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.599633 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-token\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.599633 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599522    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvgtc\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-kube-api-access-cvgtc\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.599633 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-certs\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.599775 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599660    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-socket\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.599775 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.599703    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istiod-ca-cert\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.700914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.700878    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-envoy\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.700922    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-credential-socket\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.700943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-data\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.700961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-token\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.700981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvgtc\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-kube-api-access-cvgtc\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.701008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-certs\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.701060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-socket\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701110 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.701085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istiod-ca-cert\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701415 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.701116    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-podinfo\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701474 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.701441    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-credential-socket\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.701479    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-certs\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701619 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.701596    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-data\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.701657 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.701636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-socket\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.702098 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.702075    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istiod-ca-cert\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.703468 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.703447    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-envoy\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.703720 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.703703    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-podinfo\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.708721 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.708699    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-token\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.709518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.709499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvgtc\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-kube-api-access-cvgtc\") pod \"e2e-api-b-111f37-openshift-default-67565585d8-hd5f4\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") " pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.850855 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.850773    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:47.992891 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.992839    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"]
Jul 29 00:47:47.995301 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:47:47.995274    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81efc53a_2389_45fc_bcca_98f9bd21eaa5.slice/crio-7610735f11cad1ef843c40dcc6bfd90c313c1889685866200f748fa4a46e0399 WatchSource:0}: Error finding container 7610735f11cad1ef843c40dcc6bfd90c313c1889685866200f748fa4a46e0399: Status 404 returned error can't find the container with id 7610735f11cad1ef843c40dcc6bfd90c313c1889685866200f748fa4a46e0399
Jul 29 00:47:47.997432 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.997401    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:47.997510 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.997461    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:47.997510 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:47.997490    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:47:48.009881 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:48.009861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:48.945286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:48.945253    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" event={"ID":"81efc53a-2389-45fc-bcca-98f9bd21eaa5","Type":"ContainerStarted","Data":"17ce2daa29eda5db6179997475cc83fbb4a333e89e1dcc0045de8b7f56fb465a"}
Jul 29 00:47:48.945663 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:48.945302    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" event={"ID":"81efc53a-2389-45fc-bcca-98f9bd21eaa5","Type":"ContainerStarted","Data":"7610735f11cad1ef843c40dcc6bfd90c313c1889685866200f748fa4a46e0399"}
Jul 29 00:47:48.969792 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:48.969733    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" podStartSLOduration=1.9697182880000002 podStartE2EDuration="1.969718288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:47:48.968864094 +0000 UTC m=+2400.533317064" watchObservedRunningTime="2026-07-29 00:47:48.969718288 +0000 UTC m=+2400.534171270"
Jul 29 00:47:49.092344 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:49.092316    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:47:49.095288 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:49.095266    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:47:49.096524 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:49.096502    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:47:49.099401 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:49.099384    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:47:49.851183 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:49.851146    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:49.856029 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:49.856006    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:49.950683 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:49.950641    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:49.951518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:49.951499    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:47:50.881234 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:50.881206    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:50.964002 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:50.963965    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:51.044204 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:51.044170    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:51.617606 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:51.617567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:51.776615 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:51.776581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:47:51.867810 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:47:51.867688    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:05.991828 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:05.991783    2559 patch_prober.go:28] interesting pod/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 00:48:05.992367 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:05.991859    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 00:48:07.041032 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:07.040998    2559 generic.go:356] "Generic (PLEG): container finished" podID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerID="17ce2daa29eda5db6179997475cc83fbb4a333e89e1dcc0045de8b7f56fb465a" exitCode=0
Jul 29 00:48:07.041457 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:07.041070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" event={"ID":"81efc53a-2389-45fc-bcca-98f9bd21eaa5","Type":"ContainerDied","Data":"17ce2daa29eda5db6179997475cc83fbb4a333e89e1dcc0045de8b7f56fb465a"}
Jul 29 00:48:07.041503 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:07.041457    2559 scope.go:117] "RemoveContainer" containerID="17ce2daa29eda5db6179997475cc83fbb4a333e89e1dcc0045de8b7f56fb465a"
Jul 29 00:48:07.042524 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:07.042502    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:48:07.042575 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:07.042561    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:48:07.042610 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:07.042593    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:48:08.048347 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:08.048313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" event={"ID":"81efc53a-2389-45fc-bcca-98f9bd21eaa5","Type":"ContainerStarted","Data":"5e0daa297892201bc3fc2f26dfa783b6a5be34788f19d14f713f6b1b301fbbfd"}
Jul 29 00:48:08.851479 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:08.851448    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:48:08.851688 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:08.851646    2559 patch_prober.go:28] interesting pod/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 29 00:48:08.851740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:08.851714    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 29 00:48:09.851919 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:09.851883    2559 patch_prober.go:28] interesting pod/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 29 00:48:09.852306 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:09.851951    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 29 00:48:10.851500 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:10.851459    2559 patch_prober.go:28] interesting pod/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 29 00:48:10.851746 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:10.851525    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 29 00:48:11.854457 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:11.854425    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:48:11.854975 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:11.854832    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:48:11.855484 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:11.855464    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:48:15.875254 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:15.875222    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:18.814595 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:18.814560    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"]
Jul 29 00:48:18.815025 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:18.814978    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy"
Jul 29 00:48:18.815025 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:18.814992    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="82136832-141f-4fa9-af8a-faf83e087292" containerName="istio-proxy"
Jul 29 00:48:18.818399 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:18.818383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"
Jul 29 00:48:18.821491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:18.821439    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:48:18.821491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:18.821446    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:48:18.825870 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:18.825846    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"]
Jul 29 00:48:18.982546 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:18.982515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0cf77f-9b2b-463e-9372-9185c0ba8492-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4f3846-cdjft\" (UID: \"9d0cf77f-9b2b-463e-9372-9185c0ba8492\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"
Jul 29 00:48:19.084032 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:19.083956    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0cf77f-9b2b-463e-9372-9185c0ba8492-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4f3846-cdjft\" (UID: \"9d0cf77f-9b2b-463e-9372-9185c0ba8492\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"
Jul 29 00:48:19.084549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:19.084528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0cf77f-9b2b-463e-9372-9185c0ba8492-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-4f3846-cdjft\" (UID: \"9d0cf77f-9b2b-463e-9372-9185c0ba8492\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"
Jul 29 00:48:19.130301 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:19.130276    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"
Jul 29 00:48:19.269203 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:19.269174    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"]
Jul 29 00:48:19.271832 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:48:19.271802    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d0cf77f_9b2b_463e_9372_9185c0ba8492.slice/crio-d20f9f9cdacb7891cbf1a435bd26eee9120074ab05eb7f8a84641ea60d658910 WatchSource:0}: Error finding container d20f9f9cdacb7891cbf1a435bd26eee9120074ab05eb7f8a84641ea60d658910: Status 404 returned error can't find the container with id d20f9f9cdacb7891cbf1a435bd26eee9120074ab05eb7f8a84641ea60d658910
Jul 29 00:48:20.117914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:20.117884    2559 generic.go:356] "Generic (PLEG): container finished" podID="9d0cf77f-9b2b-463e-9372-9185c0ba8492" containerID="04ba9f7a22fa5e96ce151d37cbb6bf29bd1095408de829579252a41f3eceafc9" exitCode=0
Jul 29 00:48:20.118214 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:20.117935    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft" event={"ID":"9d0cf77f-9b2b-463e-9372-9185c0ba8492","Type":"ContainerDied","Data":"04ba9f7a22fa5e96ce151d37cbb6bf29bd1095408de829579252a41f3eceafc9"}
Jul 29 00:48:20.118214 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:20.117985    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft" event={"ID":"9d0cf77f-9b2b-463e-9372-9185c0ba8492","Type":"ContainerStarted","Data":"d20f9f9cdacb7891cbf1a435bd26eee9120074ab05eb7f8a84641ea60d658910"}
Jul 29 00:48:21.259221 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:21.259191    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"
Jul 29 00:48:21.407941 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:21.407837    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0cf77f-9b2b-463e-9372-9185c0ba8492-maas-api-service-ca\") pod \"9d0cf77f-9b2b-463e-9372-9185c0ba8492\" (UID: \"9d0cf77f-9b2b-463e-9372-9185c0ba8492\") "
Jul 29 00:48:21.408243 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:21.408218    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d0cf77f-9b2b-463e-9372-9185c0ba8492-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d0cf77f-9b2b-463e-9372-9185c0ba8492" (UID: "9d0cf77f-9b2b-463e-9372-9185c0ba8492"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:48:21.510174 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:21.510130    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d0cf77f-9b2b-463e-9372-9185c0ba8492-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:22.129450 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:22.129420    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"
Jul 29 00:48:22.129621 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:22.129420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft" event={"ID":"9d0cf77f-9b2b-463e-9372-9185c0ba8492","Type":"ContainerDied","Data":"d20f9f9cdacb7891cbf1a435bd26eee9120074ab05eb7f8a84641ea60d658910"}
Jul 29 00:48:22.129621 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:22.129543    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d20f9f9cdacb7891cbf1a435bd26eee9120074ab05eb7f8a84641ea60d658910"
Jul 29 00:48:34.278325 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:34.278284    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:34.375872 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:34.375835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:34.437070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:34.437046    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"]
Jul 29 00:48:34.439771 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:34.439751    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-4f3846-cdjft"]
Jul 29 00:48:34.440351 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:34.440335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:34.813875 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:34.813848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:35.013957 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:35.013906    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d0cf77f-9b2b-463e-9372-9185c0ba8492" path="/var/lib/kubelet/pods/9d0cf77f-9b2b-463e-9372-9185c0ba8492/volumes"
Jul 29 00:48:40.614075 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:40.614037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:40.714121 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:40.714089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:40.862400 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:40.862367    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"]
Jul 29 00:48:40.862648 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:40.862619    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy" containerID="cri-o://b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444" gracePeriod=30
Jul 29 00:48:40.880588 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:40.880562    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:41.095984 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.095956    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:41.222993 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.222905    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"]
Jul 29 00:48:41.223321 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.223308    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d0cf77f-9b2b-463e-9372-9185c0ba8492" containerName="revoke-keys"
Jul 29 00:48:41.223371 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.223323    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d0cf77f-9b2b-463e-9372-9185c0ba8492" containerName="revoke-keys"
Jul 29 00:48:41.223416 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.223407    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d0cf77f-9b2b-463e-9372-9185c0ba8492" containerName="revoke-keys"
Jul 29 00:48:41.226615 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.226600    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"
Jul 29 00:48:41.229102 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.229083    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 00:48:41.229212 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.229088    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 00:48:41.233367 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.233342    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"]
Jul 29 00:48:41.287261 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.287215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b050cb16-9e97-47dd-852e-1f63cafdc27e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-111f37-77txj\" (UID: \"b050cb16-9e97-47dd-852e-1f63cafdc27e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"
Jul 29 00:48:41.388647 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.388609    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b050cb16-9e97-47dd-852e-1f63cafdc27e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-111f37-77txj\" (UID: \"b050cb16-9e97-47dd-852e-1f63cafdc27e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"
Jul 29 00:48:41.389268 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.389246    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b050cb16-9e97-47dd-852e-1f63cafdc27e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-111f37-77txj\" (UID: \"b050cb16-9e97-47dd-852e-1f63cafdc27e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"
Jul 29 00:48:41.539199 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.539111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"
Jul 29 00:48:41.677343 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.677317    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"]
Jul 29 00:48:41.680065 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:48:41.680032    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb050cb16_9e97_47dd_852e_1f63cafdc27e.slice/crio-0cef97545aa0cedbf1e695504f6e41b89adcb6334ca9ede8caaae974a9720bf2 WatchSource:0}: Error finding container 0cef97545aa0cedbf1e695504f6e41b89adcb6334ca9ede8caaae974a9720bf2: Status 404 returned error can't find the container with id 0cef97545aa0cedbf1e695504f6e41b89adcb6334ca9ede8caaae974a9720bf2
Jul 29 00:48:41.907594 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.907561    2559 patch_prober.go:28] interesting pod/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 00:48:41.907750 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:41.907619    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 00:48:42.233837 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:42.233744    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj" event={"ID":"b050cb16-9e97-47dd-852e-1f63cafdc27e","Type":"ContainerStarted","Data":"3f583adaf2d0ffebeae3ffffe88667dfedc4c78111545c75ea164e05fc38808d"}
Jul 29 00:48:42.233837 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:42.233804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj" event={"ID":"b050cb16-9e97-47dd-852e-1f63cafdc27e","Type":"ContainerStarted","Data":"0cef97545aa0cedbf1e695504f6e41b89adcb6334ca9ede8caaae974a9720bf2"}
Jul 29 00:48:42.250485 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:42.250435    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj" podStartSLOduration=1.250420726 podStartE2EDuration="1.250420726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:48:42.249099316 +0000 UTC m=+2453.813552267" watchObservedRunningTime="2026-07-29 00:48:42.250420726 +0000 UTC m=+2453.814873678"
Jul 29 00:48:43.240575 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:43.240544    2559 generic.go:356] "Generic (PLEG): container finished" podID="b050cb16-9e97-47dd-852e-1f63cafdc27e" containerID="3f583adaf2d0ffebeae3ffffe88667dfedc4c78111545c75ea164e05fc38808d" exitCode=0
Jul 29 00:48:43.240982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:43.240594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj" event={"ID":"b050cb16-9e97-47dd-852e-1f63cafdc27e","Type":"ContainerDied","Data":"3f583adaf2d0ffebeae3ffffe88667dfedc4c78111545c75ea164e05fc38808d"}
Jul 29 00:48:44.383273 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:44.383246    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"
Jul 29 00:48:44.415999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:44.415968    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b050cb16-9e97-47dd-852e-1f63cafdc27e-maas-api-service-ca\") pod \"b050cb16-9e97-47dd-852e-1f63cafdc27e\" (UID: \"b050cb16-9e97-47dd-852e-1f63cafdc27e\") "
Jul 29 00:48:44.416315 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:44.416294    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b050cb16-9e97-47dd-852e-1f63cafdc27e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b050cb16-9e97-47dd-852e-1f63cafdc27e" (UID: "b050cb16-9e97-47dd-852e-1f63cafdc27e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:48:44.517463 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:44.517388    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b050cb16-9e97-47dd-852e-1f63cafdc27e-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:45.252139 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:45.252104    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj" event={"ID":"b050cb16-9e97-47dd-852e-1f63cafdc27e","Type":"ContainerDied","Data":"0cef97545aa0cedbf1e695504f6e41b89adcb6334ca9ede8caaae974a9720bf2"}
Jul 29 00:48:45.252307 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:45.252153    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0cef97545aa0cedbf1e695504f6e41b89adcb6334ca9ede8caaae974a9720bf2"
Jul 29 00:48:45.252307 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:45.252114    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"
Jul 29 00:48:46.130248 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.130194    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:48:46.236096 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236061    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-podinfo\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236117    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-token\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236145    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l8fb\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-kube-api-access-5l8fb\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236183    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-socket\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236262 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236213    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istiod-ca-cert\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236262    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-data\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236291    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-credential-socket\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236345    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-certs\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236373    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-envoy\") pod \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\" (UID: \"8fbeb1b0-6322-42ba-938f-08cf95b0b858\") "
Jul 29 00:48:46.236730 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236527    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:48:46.236730 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236648    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:46.236852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236724    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:48:46.236852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236785    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:48:46.236967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.236851    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:48:46.237556 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.237521    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-data" (OuterVolumeSpecName: "istio-data") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:48:46.238714 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.238582    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:48:46.238714 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.238661    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-kube-api-access-5l8fb" (OuterVolumeSpecName: "kube-api-access-5l8fb") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "kube-api-access-5l8fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:48:46.238714 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.238698    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-token" (OuterVolumeSpecName: "istio-token") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:48:46.238907 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.238880    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8fbeb1b0-6322-42ba-938f-08cf95b0b858" (UID: "8fbeb1b0-6322-42ba-938f-08cf95b0b858"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:48:46.259242 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.259191    2559 generic.go:356] "Generic (PLEG): container finished" podID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerID="b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444" exitCode=0
Jul 29 00:48:46.259360 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.259254    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"
Jul 29 00:48:46.259360 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.259253    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" event={"ID":"8fbeb1b0-6322-42ba-938f-08cf95b0b858","Type":"ContainerDied","Data":"b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444"}
Jul 29 00:48:46.259449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.259380    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288" event={"ID":"8fbeb1b0-6322-42ba-938f-08cf95b0b858","Type":"ContainerDied","Data":"0cbd39475528c135346d7462f9bbcad8f16b98f7e6f790b61489ce0cb7c63dde"}
Jul 29 00:48:46.259449 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.259411    2559 scope.go:117] "RemoveContainer" containerID="b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444"
Jul 29 00:48:46.269530 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.269512    2559 scope.go:117] "RemoveContainer" containerID="d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025"
Jul 29 00:48:46.277916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.277901    2559 scope.go:117] "RemoveContainer" containerID="b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444"
Jul 29 00:48:46.278177 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:48:46.278156    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444\": container with ID starting with b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444 not found: ID does not exist" containerID="b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444"
Jul 29 00:48:46.278228 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.278185    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444"} err="failed to get container status \"b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444\": rpc error: code = NotFound desc = could not find container \"b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444\": container with ID starting with b21e359e47cd9051be88bef80dd919c4cc69b3616d4754e596388bd778a63444 not found: ID does not exist"
Jul 29 00:48:46.278228 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.278201    2559 scope.go:117] "RemoveContainer" containerID="d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025"
Jul 29 00:48:46.278442 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:48:46.278422    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025\": container with ID starting with d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025 not found: ID does not exist" containerID="d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025"
Jul 29 00:48:46.278498 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.278452    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025"} err="failed to get container status \"d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025\": rpc error: code = NotFound desc = could not find container \"d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025\": container with ID starting with d97500dd6a3263464bf792b8cd990cf4056e65bf0c57ea49fbda4a227ce7a025 not found: ID does not exist"
Jul 29 00:48:46.281985 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.281965    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"]
Jul 29 00:48:46.285543 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.285522    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4f3846-openshift-default-c79f9bf9d-5b288"]
Jul 29 00:48:46.337417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.337380    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:46.337417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.337416    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:46.337574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.337439    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:46.337574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.337448    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:46.337574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.337456    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:46.337574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.337464    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:46.337574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.337471    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:46.337574 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:46.337478    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l8fb\" (UniqueName: \"kubernetes.io/projected/8fbeb1b0-6322-42ba-938f-08cf95b0b858-kube-api-access-5l8fb\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:48:47.012792 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:47.012750    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" path="/var/lib/kubelet/pods/8fbeb1b0-6322-42ba-938f-08cf95b0b858/volumes"
Jul 29 00:48:49.288724 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:49.288692    2559 scope.go:117] "RemoveContainer" containerID="787a03ba56547f221e0d0734a6f4cc04289aac03f8d06b5182cc30919e984219"
Jul 29 00:48:56.779610 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:56.779573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:56.846274 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:56.846241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:56.907545 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:56.907512    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:56.986823 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:56.986785    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"]
Jul 29 00:48:56.996273 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:56.996242    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-111f37-77txj"]
Jul 29 00:48:57.011694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:57.011640    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b050cb16-9e97-47dd-852e-1f63cafdc27e" path="/var/lib/kubelet/pods/b050cb16-9e97-47dd-852e-1f63cafdc27e/volumes"
Jul 29 00:48:57.034202 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:57.034142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:48:57.347117 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:48:57.347027    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:03.008319 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:03.008278    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:03.130123 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:03.130089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:03.239054 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:03.239008    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"]
Jul 29 00:49:03.239305 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:03.239260    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy" containerID="cri-o://5e0daa297892201bc3fc2f26dfa783b6a5be34788f19d14f713f6b1b301fbbfd" gracePeriod=30
Jul 29 00:49:03.263101 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:03.263012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:03.495044 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:03.495014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:03.818404 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:03.818375    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:04.103867 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.103786    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"]
Jul 29 00:49:04.104320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.104153    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b050cb16-9e97-47dd-852e-1f63cafdc27e" containerName="revoke-keys"
Jul 29 00:49:04.104320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.104164    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b050cb16-9e97-47dd-852e-1f63cafdc27e" containerName="revoke-keys"
Jul 29 00:49:04.104320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.104196    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy"
Jul 29 00:49:04.104320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.104202    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy"
Jul 29 00:49:04.104320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.104268    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b050cb16-9e97-47dd-852e-1f63cafdc27e" containerName="revoke-keys"
Jul 29 00:49:04.104320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.104278    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy"
Jul 29 00:49:04.104320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.104285    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy"
Jul 29 00:49:04.107415 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.107397    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.110090 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.110071    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d90846-openshift-default-dockercfg-m67vh\""
Jul 29 00:49:04.117853 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.117832    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"]
Jul 29 00:49:04.119941 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.119923    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:04.190688 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istiod-ca-cert\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.190829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190707    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-socket\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.190829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-podinfo\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.190829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190740    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pmsb\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-kube-api-access-8pmsb\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.190829 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-credential-socket\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.190983 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-envoy\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.190983 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-token\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.190983 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190891    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-certs\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.190983 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.190922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-data\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292097    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-socket\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292134    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-podinfo\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292398 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pmsb\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-kube-api-access-8pmsb\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292398 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292294    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-credential-socket\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292398 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292330    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-envoy\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292398 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-token\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292618 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292415    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-certs\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292618 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-data\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292618 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292531    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istiod-ca-cert\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292618 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-socket\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-credential-socket\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-certs\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.292981 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.292943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-data\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.293165 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.293147    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istiod-ca-cert\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.294636 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.294617    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-envoy\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.294884 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.294868    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-podinfo\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.301662 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.301634    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-token\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.301662 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.301645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pmsb\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-kube-api-access-8pmsb\") pod \"e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") " pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.417963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.417933    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:04.559988 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.559963    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"]
Jul 29 00:49:04.561603 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:49:04.561566    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ac508c_a673_4ca5_a98b_ca431bc25e3a.slice/crio-da3c5bd94a3e0ced3b034fcf5dc250ce678553ca192142770add84f3784ff8be WatchSource:0}: Error finding container da3c5bd94a3e0ced3b034fcf5dc250ce678553ca192142770add84f3784ff8be: Status 404 returned error can't find the container with id da3c5bd94a3e0ced3b034fcf5dc250ce678553ca192142770add84f3784ff8be
Jul 29 00:49:04.563871 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.563831    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:04.563970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.563911    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:04.563970 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.563954    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:04.608202 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:04.608183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:05.360811 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:05.360769    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" event={"ID":"07ac508c-a673-4ca5-a98b-ca431bc25e3a","Type":"ContainerStarted","Data":"7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3"}
Jul 29 00:49:05.361272 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:05.360845    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" event={"ID":"07ac508c-a673-4ca5-a98b-ca431bc25e3a","Type":"ContainerStarted","Data":"da3c5bd94a3e0ced3b034fcf5dc250ce678553ca192142770add84f3784ff8be"}
Jul 29 00:49:05.383064 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:05.383010    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" podStartSLOduration=1.382993637 podStartE2EDuration="1.382993637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:49:05.380144678 +0000 UTC m=+2476.944597629" watchObservedRunningTime="2026-07-29 00:49:05.382993637 +0000 UTC m=+2476.947446590"
Jul 29 00:49:05.418822 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:05.418790    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:05.423730 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:05.423707    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:06.367445 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:06.367410    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:06.368399 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:06.368376    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:06.621241 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:06.621148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:07.273316 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:07.273281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:07.357837 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:07.357808    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:07.477513 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:07.477481    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:07.889716 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:07.889689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:07.993867 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:07.993835    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:08.093862 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.093831    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:08.382493 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.382457    2559 generic.go:356] "Generic (PLEG): container finished" podID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerID="5e0daa297892201bc3fc2f26dfa783b6a5be34788f19d14f713f6b1b301fbbfd" exitCode=0
Jul 29 00:49:08.382691 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.382525    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" event={"ID":"81efc53a-2389-45fc-bcca-98f9bd21eaa5","Type":"ContainerDied","Data":"5e0daa297892201bc3fc2f26dfa783b6a5be34788f19d14f713f6b1b301fbbfd"}
Jul 29 00:49:08.382691 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.382587    2559 scope.go:117] "RemoveContainer" containerID="17ce2daa29eda5db6179997475cc83fbb4a333e89e1dcc0045de8b7f56fb465a"
Jul 29 00:49:08.505475 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.505419    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:49:08.633387 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633358    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-credential-socket\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633406    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-podinfo\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633426    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-token\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633461    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-envoy\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633489    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istiod-ca-cert\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633516    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-data\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633539    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-socket\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633612    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-certs\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633639    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvgtc\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-kube-api-access-cvgtc\") pod \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\" (UID: \"81efc53a-2389-45fc-bcca-98f9bd21eaa5\") "
Jul 29 00:49:08.633914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633739    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:49:08.634083 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633913    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:49:08.634083 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633952    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:49:08.634083 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.633991    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:08.634083 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.634009    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:08.634290 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.634086    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 00:49:08.634584 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.634559    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-data" (OuterVolumeSpecName: "istio-data") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:49:08.635963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.635943    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:49:08.636061 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.635957    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-kube-api-access-cvgtc" (OuterVolumeSpecName: "kube-api-access-cvgtc") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "kube-api-access-cvgtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:49:08.636161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.636141    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 00:49:08.636161 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.636145    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-token" (OuterVolumeSpecName: "istio-token") pod "81efc53a-2389-45fc-bcca-98f9bd21eaa5" (UID: "81efc53a-2389-45fc-bcca-98f9bd21eaa5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:49:08.734946 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.734914    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:08.734946 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.734941    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:08.734946 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.734949    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:08.735175 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.734957    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvgtc\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-kube-api-access-cvgtc\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:08.735175 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.734966    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:08.735175 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.734974    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:08.735175 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:08.734981    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81efc53a-2389-45fc-bcca-98f9bd21eaa5-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:49:09.389153 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:09.389124    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"
Jul 29 00:49:09.389153 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:09.389128    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4" event={"ID":"81efc53a-2389-45fc-bcca-98f9bd21eaa5","Type":"ContainerDied","Data":"7610735f11cad1ef843c40dcc6bfd90c313c1889685866200f748fa4a46e0399"}
Jul 29 00:49:09.389403 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:09.389190    2559 scope.go:117] "RemoveContainer" containerID="5e0daa297892201bc3fc2f26dfa783b6a5be34788f19d14f713f6b1b301fbbfd"
Jul 29 00:49:09.408389 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:09.408358    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"]
Jul 29 00:49:09.411870 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:09.411847    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-111f37-openshift-default-67565585d8-hd5f4"]
Jul 29 00:49:11.011394 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:11.011358    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" path="/var/lib/kubelet/pods/81efc53a-2389-45fc-bcca-98f9bd21eaa5/volumes"
Jul 29 00:49:20.448295 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:20.448260    2559 generic.go:356] "Generic (PLEG): container finished" podID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerID="7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3" exitCode=0
Jul 29 00:49:20.448732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:20.448328    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" event={"ID":"07ac508c-a673-4ca5-a98b-ca431bc25e3a","Type":"ContainerDied","Data":"7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3"}
Jul 29 00:49:20.448732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:20.448718    2559 scope.go:117] "RemoveContainer" containerID="7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3"
Jul 29 00:49:20.449775 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:20.449750    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:20.449845 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:20.449814    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:20.449882 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:20.449845    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:21.368101 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:21.368011    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:21.454843 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:21.454807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" event={"ID":"07ac508c-a673-4ca5-a98b-ca431bc25e3a","Type":"ContainerStarted","Data":"98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a"}
Jul 29 00:49:22.418777 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:22.418729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:22.419730 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:22.419705    2559 patch_prober.go:28] interesting pod/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 00:49:22.419840 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:22.419787    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 00:49:23.419153 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:23.419118    2559 patch_prober.go:28] interesting pod/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 00:49:23.419580 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:23.419176    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 00:49:24.418543 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:24.418503    2559 patch_prober.go:28] interesting pod/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 00:49:24.418749 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:24.418561    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 00:49:25.422304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:25.422271    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:25.422699 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:25.422533    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:25.423187 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:25.423171    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 00:49:32.296292 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.296259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:32.589328 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.589246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:32.888264 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.888233    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"]
Jul 29 00:49:32.888630 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.888617    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy"
Jul 29 00:49:32.888803 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.888632    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy"
Jul 29 00:49:32.888803 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.888657    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy"
Jul 29 00:49:32.888803 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.888681    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fbeb1b0-6322-42ba-938f-08cf95b0b858" containerName="istio-proxy"
Jul 29 00:49:32.888803 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.888746    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy"
Jul 29 00:49:32.891933 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.891915    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.894854 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.894830    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-12505f-openshift-default-dockercfg-kctkr\""
Jul 29 00:49:32.902785 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.902766    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"]
Jul 29 00:49:32.927201 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.927166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:32.948864 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.948838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-envoy\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.948957 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.948869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-data\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.948957 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.948904    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-credential-socket\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.949044 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.948978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbrr4\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-kube-api-access-tbrr4\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.949044 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.949025    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-socket\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.949122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.949043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istiod-ca-cert\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.949122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.949081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-token\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.949122 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.949102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-certs\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:32.949226 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:32.949125    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-podinfo\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.022046 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.021989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:33.050099 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-socket\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050203 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050102    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istiod-ca-cert\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050203 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-token\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050374 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-certs\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-podinfo\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-envoy\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-data\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050480    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-credential-socket\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050534 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbrr4\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-kube-api-access-tbrr4\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050580    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-socket\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050798 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-certs\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050887 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050865    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-data\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050928 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istiod-ca-cert\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.050966 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.050937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-credential-socket\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.052897 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.052878    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-envoy\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.052991 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.052941    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-podinfo\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.057880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.057853    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbrr4\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-kube-api-access-tbrr4\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.058412 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.058384    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-token\") pod \"e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") " pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.203931 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.203846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:33.347402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.347379    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"]
Jul 29 00:49:33.348723 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:49:33.348697    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0db606_b3d5_48c1_89a9_8c3d5ea4c1f9.slice/crio-8530b11dc8d5f62baebddadf8a7d958ae1e517e46a583c3e2e12c7dde6e99059 WatchSource:0}: Error finding container 8530b11dc8d5f62baebddadf8a7d958ae1e517e46a583c3e2e12c7dde6e99059: Status 404 returned error can't find the container with id 8530b11dc8d5f62baebddadf8a7d958ae1e517e46a583c3e2e12c7dde6e99059
Jul 29 00:49:33.350964 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.350933    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:33.351051 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.350995    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:33.351051 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.351040    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:33.526401 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.526305    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" event={"ID":"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9","Type":"ContainerStarted","Data":"139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8"}
Jul 29 00:49:33.526401 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.526365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" event={"ID":"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9","Type":"ContainerStarted","Data":"8530b11dc8d5f62baebddadf8a7d958ae1e517e46a583c3e2e12c7dde6e99059"}
Jul 29 00:49:33.545374 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:33.545330    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" podStartSLOduration=1.545315693 podStartE2EDuration="1.545315693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:49:33.544647978 +0000 UTC m=+2505.109100928" watchObservedRunningTime="2026-07-29 00:49:33.545315693 +0000 UTC m=+2505.109768721"
Jul 29 00:49:34.204719 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:34.204688    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:34.209629 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:34.209605    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:34.531953 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:34.531867    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:34.532682 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:34.532649    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:35.461312 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:35.461259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:35.550758 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:35.550724    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:35.628538 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:35.628506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:36.042492 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:36.042458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:36.246881 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:36.246849    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:36.328993 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:36.328916    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:41.189472 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:41.189382    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:49:48.613473 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:48.613439    2559 generic.go:356] "Generic (PLEG): container finished" podID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerID="139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8" exitCode=0
Jul 29 00:49:48.613900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:48.613498    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" event={"ID":"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9","Type":"ContainerDied","Data":"139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8"}
Jul 29 00:49:48.613900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:48.613858    2559 scope.go:117] "RemoveContainer" containerID="139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8"
Jul 29 00:49:48.614863 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:48.614833    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:48.614919 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:48.614905    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:48.614954 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:48.614941    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:49:49.532816 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:49.532776    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:49.620516 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:49.620483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" event={"ID":"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9","Type":"ContainerStarted","Data":"ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47"}
Jul 29 00:49:50.204268 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:50.204230    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:50.205336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:50.205311    2559 patch_prober.go:28] interesting pod/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 29 00:49:50.205448 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:50.205367    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 29 00:49:51.204547 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:51.204510    2559 patch_prober.go:28] interesting pod/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 29 00:49:51.204963 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:51.204570    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 29 00:49:52.204329 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:52.204291    2559 patch_prober.go:28] interesting pod/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 29 00:49:52.204507 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:52.204345    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 29 00:49:53.204812 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:53.204776    2559 patch_prober.go:28] interesting pod/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 29 00:49:53.205209 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:53.204830    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 29 00:49:54.208487 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:54.208450    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:54.208899 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:54.208882    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:49:54.209684 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:49:54.209644    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 00:50:00.473020 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:00.472988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:50:15.614204 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.614158    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"]
Jul 29 00:50:15.614759 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.614740    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy"
Jul 29 00:50:15.614844 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.614761    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy"
Jul 29 00:50:15.614899 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.614880    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81efc53a-2389-45fc-bcca-98f9bd21eaa5" containerName="istio-proxy"
Jul 29 00:50:15.618252 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.618229    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.622763 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.622741    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d90846\"/\"kube-root-ca.crt\""
Jul 29 00:50:15.622888 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.622766    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d90846\"/\"default-dockercfg-v9q6t\""
Jul 29 00:50:15.622888 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.622789    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d90846\"/\"openshift-service-ca.crt\""
Jul 29 00:50:15.622888 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.622741    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d90846\"/\"auth-test-model-d90846-kserve-self-signed-certs\""
Jul 29 00:50:15.628040 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.628018    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"]
Jul 29 00:50:15.647769 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.647734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-home\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.647769 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.647772    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-dshm\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.648012 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.647801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-tmp-dir\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.648012 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.647863    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6fgf\" (UniqueName: \"kubernetes.io/projected/c0f88dec-bb29-4473-8de1-04a1518b4c26-kube-api-access-j6fgf\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.648012 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.647954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f88dec-bb29-4473-8de1-04a1518b4c26-tls-certs\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.648145 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.648010    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-model-cache\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.748480 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.748445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-tmp-dir\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.748480 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.748484    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6fgf\" (UniqueName: \"kubernetes.io/projected/c0f88dec-bb29-4473-8de1-04a1518b4c26-kube-api-access-j6fgf\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.748771 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.748714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f88dec-bb29-4473-8de1-04a1518b4c26-tls-certs\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.748834 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.748793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-model-cache\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.748914 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.748899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-home\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.748969 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.748934    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-dshm\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.748969 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.748939    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-tmp-dir\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.749102 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.749083    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-model-cache\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.749260 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.749242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-home\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.751151 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.751126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-dshm\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.751661 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.751639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f88dec-bb29-4473-8de1-04a1518b4c26-tls-certs\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.756377 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.756357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6fgf\" (UniqueName: \"kubernetes.io/projected/c0f88dec-bb29-4473-8de1-04a1518b4c26-kube-api-access-j6fgf\") pod \"auth-test-model-d90846-kserve-8496ff95bc-nwtbl\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") " pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:15.799083 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.799048    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:50:15.929687 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:15.929623    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:16.077926 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:16.077880    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"]
Jul 29 00:50:16.080234 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:50:16.080205    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0f88dec_bb29_4473_8de1_04a1518b4c26.slice/crio-fe750c56a7eea8b74fa8f4ed1faff9e3c24568c4bf0eb7753d16072e5afc838a WatchSource:0}: Error finding container fe750c56a7eea8b74fa8f4ed1faff9e3c24568c4bf0eb7753d16072e5afc838a: Status 404 returned error can't find the container with id fe750c56a7eea8b74fa8f4ed1faff9e3c24568c4bf0eb7753d16072e5afc838a
Jul 29 00:50:16.762208 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:16.762164    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl" event={"ID":"c0f88dec-bb29-4473-8de1-04a1518b4c26","Type":"ContainerStarted","Data":"50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa"}
Jul 29 00:50:16.762603 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:16.762215    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl" event={"ID":"c0f88dec-bb29-4473-8de1-04a1518b4c26","Type":"ContainerStarted","Data":"fe750c56a7eea8b74fa8f4ed1faff9e3c24568c4bf0eb7753d16072e5afc838a"}
Jul 29 00:50:16.780904 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:16.780795    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl" podStartSLOduration=1.780780697 podStartE2EDuration="1.780780697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:50:16.778703806 +0000 UTC m=+2548.343156759" watchObservedRunningTime="2026-07-29 00:50:16.780780697 +0000 UTC m=+2548.345233671"
Jul 29 00:50:25.929926 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:25.929884    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:25.930436 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:25.929943    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:25.942693 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:25.942649    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:26.829320 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:26.829288    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:50:49.021014 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.020960    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"]
Jul 29 00:50:49.025982 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.025960    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"]
Jul 29 00:50:49.026116 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.026041    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.028821 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.028795    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"default-dockercfg-j5fvg\""
Jul 29 00:50:49.028960 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.028794    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"kube-root-ca.crt\""
Jul 29 00:50:49.028960 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.028879    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"auth-test-model-12505f-kserve-self-signed-certs\""
Jul 29 00:50:49.028960 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.028943    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"openshift-service-ca.crt\""
Jul 29 00:50:49.043499 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.043479    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:50:49.163917 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.163881    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tls-certs\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.164075 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.163925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmk8p\" (UniqueName: \"kubernetes.io/projected/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-kube-api-access-vmk8p\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.164075 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.163997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tmp-dir\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.164075 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.164032    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-dshm\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.164075 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.164063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-model-cache\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.164236 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.164127    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-home\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.265317 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-home\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.265535 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tls-certs\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.265535 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmk8p\" (UniqueName: \"kubernetes.io/projected/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-kube-api-access-vmk8p\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.265535 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tmp-dir\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.265535 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-dshm\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.265535 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265467    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-model-cache\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.265843 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-home\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.265910 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tmp-dir\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.266018 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.265995    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-model-cache\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.267906 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.267887    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-dshm\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.268390 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.268375    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tls-certs\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.273763 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.273707    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmk8p\" (UniqueName: \"kubernetes.io/projected/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-kube-api-access-vmk8p\") pod \"auth-test-model-12505f-kserve-679994f85f-vllxj\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") " pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.336330 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.336304    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:49.473054 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.473015    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"]
Jul 29 00:50:49.476348 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:50:49.476319    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1db39be1_a83e_4f96_a0cd_436b9cbe34a8.slice/crio-a90c20cc1f79d188d0dc8749477f6f23e4c579c7bab118f9f7f3dabfac5473df WatchSource:0}: Error finding container a90c20cc1f79d188d0dc8749477f6f23e4c579c7bab118f9f7f3dabfac5473df: Status 404 returned error can't find the container with id a90c20cc1f79d188d0dc8749477f6f23e4c579c7bab118f9f7f3dabfac5473df
Jul 29 00:50:49.948319 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.948278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj" event={"ID":"1db39be1-a83e-4f96-a0cd-436b9cbe34a8","Type":"ContainerStarted","Data":"d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487"}
Jul 29 00:50:49.948504 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.948334    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj" event={"ID":"1db39be1-a83e-4f96-a0cd-436b9cbe34a8","Type":"ContainerStarted","Data":"a90c20cc1f79d188d0dc8749477f6f23e4c579c7bab118f9f7f3dabfac5473df"}
Jul 29 00:50:49.964660 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:49.964615    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj" podStartSLOduration=1.96460232 podStartE2EDuration="1.96460232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:50:49.963054079 +0000 UTC m=+2581.527507034" watchObservedRunningTime="2026-07-29 00:50:49.96460232 +0000 UTC m=+2581.529055271"
Jul 29 00:50:59.337456 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:59.337419    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:59.338087 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:59.337469    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:50:59.350178 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:50:59.350150    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:51:00.010186 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:51:00.010157    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:51:32.881708 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:51:32.881637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:51:32.931633 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:51:32.931609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:51:40.351836 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:51:40.351798    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:51:49.331598 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:51:49.331563    2559 scope.go:117] "RemoveContainer" containerID="04ca80c7f2f61b5f1df0780727d5eaf9a2deafa3e276731d4e36e7f77534e663"
Jul 29 00:52:35.521839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:52:35.521803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:52:49.125124 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:52:49.125042    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:52:49.129599 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:52:49.129577    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:52:49.129737 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:52:49.129582    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:52:49.133561 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:52:49.133545    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:53:49.361141 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:53:49.361103    2559 scope.go:117] "RemoveContainer" containerID="3dc4489324db010462bd72fa3d0384b062603ffde0bcfaee1cf30603270291d2"
Jul 29 00:54:49.382247 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:54:49.382213    2559 scope.go:117] "RemoveContainer" containerID="3f583adaf2d0ffebeae3ffffe88667dfedc4c78111545c75ea164e05fc38808d"
Jul 29 00:54:49.390860 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:54:49.390841    2559 scope.go:117] "RemoveContainer" containerID="04ba9f7a22fa5e96ce151d37cbb6bf29bd1095408de829579252a41f3eceafc9"
Jul 29 00:55:15.620588 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:15.620556    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"]
Jul 29 00:55:15.668390 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:15.668353    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:55:16.391528 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:16.391494    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"]
Jul 29 00:55:17.443522 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:17.443482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:55:24.810224 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.810192    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"]
Jul 29 00:55:24.813964 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.813946    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:24.816645 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.816626    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d90846\"/\"sub-test-model-d90846-kserve-self-signed-certs\""
Jul 29 00:55:24.825101 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.825080    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"]
Jul 29 00:55:24.844370 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.844343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:55:24.898828 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.898803    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-dshm\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:24.898950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.898849    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4hrh\" (UniqueName: \"kubernetes.io/projected/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-kube-api-access-g4hrh\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:24.898950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.898903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-home\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:24.898950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.898937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tmp-dir\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:24.899126 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.898988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tls-certs\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:24.899126 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:24.899081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-model-cache\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.000776 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.000691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4hrh\" (UniqueName: \"kubernetes.io/projected/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-kube-api-access-g4hrh\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.001165 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.001141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-home\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.001336 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.001319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tmp-dir\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.001459 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.001433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tls-certs\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.001596 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.001539    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-model-cache\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.001689 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.001590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-dshm\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.001689 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.001590    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-home\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.002086 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.002064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-model-cache\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.002229 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.002126    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tmp-dir\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.004340 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.004311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tls-certs\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.004540 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.004521    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-dshm\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.009005 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.008973    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4hrh\" (UniqueName: \"kubernetes.io/projected/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-kube-api-access-g4hrh\") pod \"sub-test-model-d90846-kserve-6cbf94b56f-t7xfg\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") " pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.124220 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.124188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:25.262177 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.262147    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"]
Jul 29 00:55:25.264768 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:55:25.264743    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd94d0f27_ad9d_4eb3_9643_8da7205a3d19.slice/crio-678d4948f3887a0a8e6ca4c01e17225c5b608eb4ff828a063a52fb91e040a7b8 WatchSource:0}: Error finding container 678d4948f3887a0a8e6ca4c01e17225c5b608eb4ff828a063a52fb91e040a7b8: Status 404 returned error can't find the container with id 678d4948f3887a0a8e6ca4c01e17225c5b608eb4ff828a063a52fb91e040a7b8
Jul 29 00:55:25.385337 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.385255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg" event={"ID":"d94d0f27-ad9d-4eb3-9643-8da7205a3d19","Type":"ContainerStarted","Data":"290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824"}
Jul 29 00:55:25.385337 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.385302    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg" event={"ID":"d94d0f27-ad9d-4eb3-9643-8da7205a3d19","Type":"ContainerStarted","Data":"678d4948f3887a0a8e6ca4c01e17225c5b608eb4ff828a063a52fb91e040a7b8"}
Jul 29 00:55:25.401738 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:25.401638    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg" podStartSLOduration=1.401620559 podStartE2EDuration="1.401620559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:55:25.401403505 +0000 UTC m=+2856.965856457" watchObservedRunningTime="2026-07-29 00:55:25.401620559 +0000 UTC m=+2856.966073512"
Jul 29 00:55:30.639993 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.639955    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl" podUID="c0f88dec-bb29-4473-8de1-04a1518b4c26" containerName="main" containerID="cri-o://50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa" gracePeriod=45
Jul 29 00:55:30.889279 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.889254    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:55:30.953521 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953447    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-home\") pod \"c0f88dec-bb29-4473-8de1-04a1518b4c26\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") "
Jul 29 00:55:30.953521 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953483    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-model-cache\") pod \"c0f88dec-bb29-4473-8de1-04a1518b4c26\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") "
Jul 29 00:55:30.953521 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953509    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-dshm\") pod \"c0f88dec-bb29-4473-8de1-04a1518b4c26\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") "
Jul 29 00:55:30.953830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953558    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-tmp-dir\") pod \"c0f88dec-bb29-4473-8de1-04a1518b4c26\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") "
Jul 29 00:55:30.953830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953591    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6fgf\" (UniqueName: \"kubernetes.io/projected/c0f88dec-bb29-4473-8de1-04a1518b4c26-kube-api-access-j6fgf\") pod \"c0f88dec-bb29-4473-8de1-04a1518b4c26\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") "
Jul 29 00:55:30.953830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953622    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f88dec-bb29-4473-8de1-04a1518b4c26-tls-certs\") pod \"c0f88dec-bb29-4473-8de1-04a1518b4c26\" (UID: \"c0f88dec-bb29-4473-8de1-04a1518b4c26\") "
Jul 29 00:55:30.953830 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953795    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-home" (OuterVolumeSpecName: "home") pod "c0f88dec-bb29-4473-8de1-04a1518b4c26" (UID: "c0f88dec-bb29-4473-8de1-04a1518b4c26"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:55:30.954003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953809    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-model-cache" (OuterVolumeSpecName: "model-cache") pod "c0f88dec-bb29-4473-8de1-04a1518b4c26" (UID: "c0f88dec-bb29-4473-8de1-04a1518b4c26"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:55:30.954003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.953891    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c0f88dec-bb29-4473-8de1-04a1518b4c26" (UID: "c0f88dec-bb29-4473-8de1-04a1518b4c26"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:55:30.954117 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.954028    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:30.954117 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.954042    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:30.954117 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.954052    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:30.956043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.956022    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0f88dec-bb29-4473-8de1-04a1518b4c26-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c0f88dec-bb29-4473-8de1-04a1518b4c26" (UID: "c0f88dec-bb29-4473-8de1-04a1518b4c26"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:55:30.956043 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.956025    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0f88dec-bb29-4473-8de1-04a1518b4c26-kube-api-access-j6fgf" (OuterVolumeSpecName: "kube-api-access-j6fgf") pod "c0f88dec-bb29-4473-8de1-04a1518b4c26" (UID: "c0f88dec-bb29-4473-8de1-04a1518b4c26"). InnerVolumeSpecName "kube-api-access-j6fgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:55:30.956280 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:30.956026    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-dshm" (OuterVolumeSpecName: "dshm") pod "c0f88dec-bb29-4473-8de1-04a1518b4c26" (UID: "c0f88dec-bb29-4473-8de1-04a1518b4c26"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:55:31.055426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.055396    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0f88dec-bb29-4473-8de1-04a1518b4c26-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:31.055426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.055421    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6fgf\" (UniqueName: \"kubernetes.io/projected/c0f88dec-bb29-4473-8de1-04a1518b4c26-kube-api-access-j6fgf\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:31.055426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.055431    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0f88dec-bb29-4473-8de1-04a1518b4c26-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:31.411396 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.411353    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj" podUID="1db39be1-a83e-4f96-a0cd-436b9cbe34a8" containerName="main" containerID="cri-o://d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487" gracePeriod=45
Jul 29 00:55:31.417313 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.417284    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0f88dec-bb29-4473-8de1-04a1518b4c26" containerID="50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa" exitCode=0
Jul 29 00:55:31.417417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.417350    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"
Jul 29 00:55:31.417417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.417368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl" event={"ID":"c0f88dec-bb29-4473-8de1-04a1518b4c26","Type":"ContainerDied","Data":"50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa"}
Jul 29 00:55:31.417494 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.417424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl" event={"ID":"c0f88dec-bb29-4473-8de1-04a1518b4c26","Type":"ContainerDied","Data":"fe750c56a7eea8b74fa8f4ed1faff9e3c24568c4bf0eb7753d16072e5afc838a"}
Jul 29 00:55:31.417494 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.417448    2559 scope.go:117] "RemoveContainer" containerID="50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa"
Jul 29 00:55:31.426073 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.426054    2559 scope.go:117] "RemoveContainer" containerID="50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa"
Jul 29 00:55:31.426318 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:55:31.426296    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa\": container with ID starting with 50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa not found: ID does not exist" containerID="50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa"
Jul 29 00:55:31.426416 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.426326    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa"} err="failed to get container status \"50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa\": rpc error: code = NotFound desc = could not find container \"50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa\": container with ID starting with 50e54701f1aca6d6ce8622ab4fe37e92f21e38b5406bbfae91c9e6a262f8bbfa not found: ID does not exist"
Jul 29 00:55:31.435185 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.435161    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"]
Jul 29 00:55:31.439977 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.439958    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/auth-test-model-d90846-kserve-8496ff95bc-nwtbl"]
Jul 29 00:55:31.649859 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.649834    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:55:31.761181 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761087    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tmp-dir\") pod \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") "
Jul 29 00:55:31.761181 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761156    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-dshm\") pod \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") "
Jul 29 00:55:31.761408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761218    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmk8p\" (UniqueName: \"kubernetes.io/projected/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-kube-api-access-vmk8p\") pod \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") "
Jul 29 00:55:31.761408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761254    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tls-certs\") pod \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") "
Jul 29 00:55:31.761408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761325    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-model-cache\") pod \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") "
Jul 29 00:55:31.761408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761350    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-home\") pod \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\" (UID: \"1db39be1-a83e-4f96-a0cd-436b9cbe34a8\") "
Jul 29 00:55:31.761408 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761362    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1db39be1-a83e-4f96-a0cd-436b9cbe34a8" (UID: "1db39be1-a83e-4f96-a0cd-436b9cbe34a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:55:31.762027 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761841    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:31.762167 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.761908    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "1db39be1-a83e-4f96-a0cd-436b9cbe34a8" (UID: "1db39be1-a83e-4f96-a0cd-436b9cbe34a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:55:31.762301 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.762278    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-home" (OuterVolumeSpecName: "home") pod "1db39be1-a83e-4f96-a0cd-436b9cbe34a8" (UID: "1db39be1-a83e-4f96-a0cd-436b9cbe34a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:55:31.763725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.763700    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-dshm" (OuterVolumeSpecName: "dshm") pod "1db39be1-a83e-4f96-a0cd-436b9cbe34a8" (UID: "1db39be1-a83e-4f96-a0cd-436b9cbe34a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:55:31.764012 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.763985    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1db39be1-a83e-4f96-a0cd-436b9cbe34a8" (UID: "1db39be1-a83e-4f96-a0cd-436b9cbe34a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:55:31.764095 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.764066    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-kube-api-access-vmk8p" (OuterVolumeSpecName: "kube-api-access-vmk8p") pod "1db39be1-a83e-4f96-a0cd-436b9cbe34a8" (UID: "1db39be1-a83e-4f96-a0cd-436b9cbe34a8"). InnerVolumeSpecName "kube-api-access-vmk8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:55:31.862642 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.862602    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:31.862847 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.862642    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmk8p\" (UniqueName: \"kubernetes.io/projected/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-kube-api-access-vmk8p\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:31.862847 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.862680    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:31.862847 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.862690    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:31.862847 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:31.862698    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1db39be1-a83e-4f96-a0cd-436b9cbe34a8-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:55:32.423428 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.423395    2559 generic.go:356] "Generic (PLEG): container finished" podID="1db39be1-a83e-4f96-a0cd-436b9cbe34a8" containerID="d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487" exitCode=0
Jul 29 00:55:32.423607 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.423437    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"
Jul 29 00:55:32.423607 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.423486    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj" event={"ID":"1db39be1-a83e-4f96-a0cd-436b9cbe34a8","Type":"ContainerDied","Data":"d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487"}
Jul 29 00:55:32.423607 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.423533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj" event={"ID":"1db39be1-a83e-4f96-a0cd-436b9cbe34a8","Type":"ContainerDied","Data":"a90c20cc1f79d188d0dc8749477f6f23e4c579c7bab118f9f7f3dabfac5473df"}
Jul 29 00:55:32.423607 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.423555    2559 scope.go:117] "RemoveContainer" containerID="d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487"
Jul 29 00:55:32.432614 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.432598    2559 scope.go:117] "RemoveContainer" containerID="d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487"
Jul 29 00:55:32.432872 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:55:32.432853    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487\": container with ID starting with d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487 not found: ID does not exist" containerID="d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487"
Jul 29 00:55:32.432923 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.432889    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487"} err="failed to get container status \"d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487\": rpc error: code = NotFound desc = could not find container \"d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487\": container with ID starting with d53dca73441b5b78cf233e236e97647ac3b22dc5ff5866417aaa5692f17b2487 not found: ID does not exist"
Jul 29 00:55:32.443535 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.443512    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"]
Jul 29 00:55:32.449463 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:32.449444    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/auth-test-model-12505f-kserve-679994f85f-vllxj"]
Jul 29 00:55:33.010811 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:33.010777    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1db39be1-a83e-4f96-a0cd-436b9cbe34a8" path="/var/lib/kubelet/pods/1db39be1-a83e-4f96-a0cd-436b9cbe34a8/volumes"
Jul 29 00:55:33.011198 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:33.011159    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f88dec-bb29-4473-8de1-04a1518b4c26" path="/var/lib/kubelet/pods/c0f88dec-bb29-4473-8de1-04a1518b4c26/volumes"
Jul 29 00:55:35.124686 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:35.124627    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:35.125134 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:35.124725    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:35.137353 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:35.137330    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:35.450523 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:35.450438    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:55:48.040439 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:48.040343    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:55:48.141020 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:48.140988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:55:57.608824 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.608792    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"]
Jul 29 00:55:57.609293 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.609186    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f88dec-bb29-4473-8de1-04a1518b4c26" containerName="main"
Jul 29 00:55:57.609293 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.609198    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f88dec-bb29-4473-8de1-04a1518b4c26" containerName="main"
Jul 29 00:55:57.609293 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.609229    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1db39be1-a83e-4f96-a0cd-436b9cbe34a8" containerName="main"
Jul 29 00:55:57.609293 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.609237    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1db39be1-a83e-4f96-a0cd-436b9cbe34a8" containerName="main"
Jul 29 00:55:57.609429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.609305    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f88dec-bb29-4473-8de1-04a1518b4c26" containerName="main"
Jul 29 00:55:57.609429 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.609316    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1db39be1-a83e-4f96-a0cd-436b9cbe34a8" containerName="main"
Jul 29 00:55:57.612325 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.612309    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.616123 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.616092    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"kube-root-ca.crt\""
Jul 29 00:55:57.616260 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.616134    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"default-dockercfg-j5fvg\""
Jul 29 00:55:57.616260 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.616174    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"openshift-service-ca.crt\""
Jul 29 00:55:57.616260 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.616093    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"sub-test-model-12505f-kserve-self-signed-certs\""
Jul 29 00:55:57.621480 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.621458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"]
Jul 29 00:55:57.635718 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.635688    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:55:57.695912 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.695883    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-home\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.696067 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.695915    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-model-cache\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.696067 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.695952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz8ht\" (UniqueName: \"kubernetes.io/projected/8fbcd4ae-6f3e-4153-a151-58139ae876b4-kube-api-access-mz8ht\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.696067 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.696028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-dshm\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.696223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.696073    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tmp-dir\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.696223 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.696154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tls-certs\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797028 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.796999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz8ht\" (UniqueName: \"kubernetes.io/projected/8fbcd4ae-6f3e-4153-a151-58139ae876b4-kube-api-access-mz8ht\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797193 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.797032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-dshm\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797193 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.797058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tmp-dir\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797193 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.797092    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tls-certs\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797193 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.797133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-home\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797193 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.797150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-model-cache\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797517 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.797487    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tmp-dir\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797646 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.797541    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-model-cache\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.797646 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.797611    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-home\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.799491 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.799471    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-dshm\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.799662 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.799645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tls-certs\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.804951 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.804934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz8ht\" (UniqueName: \"kubernetes.io/projected/8fbcd4ae-6f3e-4153-a151-58139ae876b4-kube-api-access-mz8ht\") pod \"sub-test-model-12505f-kserve-9c45db965-fgggn\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") " pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:57.923840 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:57.923801    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:55:58.068426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:58.068391    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"]
Jul 29 00:55:58.069363 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:55:58.069335    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fbcd4ae_6f3e_4153_a151_58139ae876b4.slice/crio-695d4c1da95d5d3b6e147afe782b4df2a1de4ec772f5ba3d5bd3d5fba640b7c8 WatchSource:0}: Error finding container 695d4c1da95d5d3b6e147afe782b4df2a1de4ec772f5ba3d5bd3d5fba640b7c8: Status 404 returned error can't find the container with id 695d4c1da95d5d3b6e147afe782b4df2a1de4ec772f5ba3d5bd3d5fba640b7c8
Jul 29 00:55:58.557281 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:58.557241    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn" event={"ID":"8fbcd4ae-6f3e-4153-a151-58139ae876b4","Type":"ContainerStarted","Data":"ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534"}
Jul 29 00:55:58.557281 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:58.557287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn" event={"ID":"8fbcd4ae-6f3e-4153-a151-58139ae876b4","Type":"ContainerStarted","Data":"695d4c1da95d5d3b6e147afe782b4df2a1de4ec772f5ba3d5bd3d5fba640b7c8"}
Jul 29 00:55:58.574564 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:55:58.574506    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn" podStartSLOduration=1.574491318 podStartE2EDuration="1.574491318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:55:58.572880397 +0000 UTC m=+2890.137333359" watchObservedRunningTime="2026-07-29 00:55:58.574491318 +0000 UTC m=+2890.138944269"
Jul 29 00:56:07.924285 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:07.924252    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:56:07.924703 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:07.924297    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:56:07.936734 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:07.936705    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:56:08.622658 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:08.622627    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:56:30.035548 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:30.035514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:56:55.586286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:55.586242    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"]
Jul 29 00:56:55.603402 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:55.603371    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:56:56.610716 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:56.610662    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"]
Jul 29 00:56:56.626941 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:56:56.626907    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:57:07.194697 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.194649    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"]
Jul 29 00:57:07.198187 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.198169    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.201120 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.201099    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d90846\"/\"rate-test-model-d90846-kserve-self-signed-certs\""
Jul 29 00:57:07.208844 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.208821    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"]
Jul 29 00:57:07.218697 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.218659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:57:07.228714 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.228687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-tmp-dir\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.228858 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.228813    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-dshm\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.228900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.228858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-model-cache\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.228900 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.228884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-home\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.228964 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.228908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj6qx\" (UniqueName: \"kubernetes.io/projected/d01738bc-f796-482c-9b07-b18656ce9848-kube-api-access-tj6qx\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.229001 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.228961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01738bc-f796-482c-9b07-b18656ce9848-tls-certs\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.329935 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.329892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-dshm\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.329935 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.329936    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-model-cache\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.330162 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.329967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-home\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.330162 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.329996    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj6qx\" (UniqueName: \"kubernetes.io/projected/d01738bc-f796-482c-9b07-b18656ce9848-kube-api-access-tj6qx\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.330162 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.330024    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01738bc-f796-482c-9b07-b18656ce9848-tls-certs\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.330162 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.330065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-tmp-dir\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.330455 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.330429    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-model-cache\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.330536 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.330439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-home\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.330536 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.330496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-tmp-dir\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.332411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.332389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-dshm\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.332579 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.332563    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01738bc-f796-482c-9b07-b18656ce9848-tls-certs\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.338584 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.338559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj6qx\" (UniqueName: \"kubernetes.io/projected/d01738bc-f796-482c-9b07-b18656ce9848-kube-api-access-tj6qx\") pod \"rate-test-model-d90846-kserve-65bd9bd499-lxqk9\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") " pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.508354 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.508239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:07.659786 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.659753    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"]
Jul 29 00:57:07.661498 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:57:07.661471    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd01738bc_f796_482c_9b07_b18656ce9848.slice/crio-423529752d3d14ec00ef41aef0110b7d6ec9e2d18d30eeaa5f2efe7949a88b98 WatchSource:0}: Error finding container 423529752d3d14ec00ef41aef0110b7d6ec9e2d18d30eeaa5f2efe7949a88b98: Status 404 returned error can't find the container with id 423529752d3d14ec00ef41aef0110b7d6ec9e2d18d30eeaa5f2efe7949a88b98
Jul 29 00:57:07.915501 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.915471    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9" event={"ID":"d01738bc-f796-482c-9b07-b18656ce9848","Type":"ContainerStarted","Data":"4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208"}
Jul 29 00:57:07.915691 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.915514    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9" event={"ID":"d01738bc-f796-482c-9b07-b18656ce9848","Type":"ContainerStarted","Data":"423529752d3d14ec00ef41aef0110b7d6ec9e2d18d30eeaa5f2efe7949a88b98"}
Jul 29 00:57:07.933183 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:07.933135    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9" podStartSLOduration=0.933119311 podStartE2EDuration="933.119311ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:57:07.930927796 +0000 UTC m=+2959.495380750" watchObservedRunningTime="2026-07-29 00:57:07.933119311 +0000 UTC m=+2959.497572318"
Jul 29 00:57:10.606782 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.606697    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg" podUID="d94d0f27-ad9d-4eb3-9643-8da7205a3d19" containerName="main" containerID="cri-o://290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824" gracePeriod=45
Jul 29 00:57:10.862295 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.862229    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:57:10.932773 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.932738    2559 generic.go:356] "Generic (PLEG): container finished" podID="d94d0f27-ad9d-4eb3-9643-8da7205a3d19" containerID="290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824" exitCode=0
Jul 29 00:57:10.932973 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.932790    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"
Jul 29 00:57:10.932973 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.932841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg" event={"ID":"d94d0f27-ad9d-4eb3-9643-8da7205a3d19","Type":"ContainerDied","Data":"290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824"}
Jul 29 00:57:10.932973 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.932892    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg" event={"ID":"d94d0f27-ad9d-4eb3-9643-8da7205a3d19","Type":"ContainerDied","Data":"678d4948f3887a0a8e6ca4c01e17225c5b608eb4ff828a063a52fb91e040a7b8"}
Jul 29 00:57:10.932973 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.932915    2559 scope.go:117] "RemoveContainer" containerID="290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824"
Jul 29 00:57:10.941615 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.941596    2559 scope.go:117] "RemoveContainer" containerID="290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824"
Jul 29 00:57:10.941946 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:57:10.941927    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824\": container with ID starting with 290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824 not found: ID does not exist" containerID="290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824"
Jul 29 00:57:10.942003 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.941955    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824"} err="failed to get container status \"290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824\": rpc error: code = NotFound desc = could not find container \"290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824\": container with ID starting with 290f770828e8d0b0c80a4ee41bd45bcf9be05cc0e37fe4ab40978f0a892c8824 not found: ID does not exist"
Jul 29 00:57:10.967780 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.967761    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-home\") pod \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") "
Jul 29 00:57:10.967877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.967786    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-dshm\") pod \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") "
Jul 29 00:57:10.967877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.967817    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tls-certs\") pod \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") "
Jul 29 00:57:10.967877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.967835    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tmp-dir\") pod \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") "
Jul 29 00:57:10.967877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.967850    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-model-cache\") pod \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") "
Jul 29 00:57:10.968087 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.967880    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4hrh\" (UniqueName: \"kubernetes.io/projected/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-kube-api-access-g4hrh\") pod \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\" (UID: \"d94d0f27-ad9d-4eb3-9643-8da7205a3d19\") "
Jul 29 00:57:10.968087 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.968061    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-home" (OuterVolumeSpecName: "home") pod "d94d0f27-ad9d-4eb3-9643-8da7205a3d19" (UID: "d94d0f27-ad9d-4eb3-9643-8da7205a3d19"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:57:10.968191 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.968152    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-model-cache" (OuterVolumeSpecName: "model-cache") pod "d94d0f27-ad9d-4eb3-9643-8da7205a3d19" (UID: "d94d0f27-ad9d-4eb3-9643-8da7205a3d19"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:57:10.968191 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.968170    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d94d0f27-ad9d-4eb3-9643-8da7205a3d19" (UID: "d94d0f27-ad9d-4eb3-9643-8da7205a3d19"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:57:10.968331 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.968313    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:10.968383 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.968337    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:10.968383 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.968351    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:10.970036 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.970009    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d94d0f27-ad9d-4eb3-9643-8da7205a3d19" (UID: "d94d0f27-ad9d-4eb3-9643-8da7205a3d19"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:57:10.970211 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.970186    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-kube-api-access-g4hrh" (OuterVolumeSpecName: "kube-api-access-g4hrh") pod "d94d0f27-ad9d-4eb3-9643-8da7205a3d19" (UID: "d94d0f27-ad9d-4eb3-9643-8da7205a3d19"). InnerVolumeSpecName "kube-api-access-g4hrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:57:10.970307 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:10.970293    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-dshm" (OuterVolumeSpecName: "dshm") pod "d94d0f27-ad9d-4eb3-9643-8da7205a3d19" (UID: "d94d0f27-ad9d-4eb3-9643-8da7205a3d19"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:57:11.069162 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.069136    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:11.069162 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.069162    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:11.069334 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.069174    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4hrh\" (UniqueName: \"kubernetes.io/projected/d94d0f27-ad9d-4eb3-9643-8da7205a3d19-kube-api-access-g4hrh\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:11.248764 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.248735    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"]
Jul 29 00:57:11.250544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.250524    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/sub-test-model-d90846-kserve-6cbf94b56f-t7xfg"]
Jul 29 00:57:11.630793 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.630751    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn" podUID="8fbcd4ae-6f3e-4153-a151-58139ae876b4" containerName="main" containerID="cri-o://ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534" gracePeriod=45
Jul 29 00:57:11.901304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.901278    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:57:11.940485 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.940450    2559 generic.go:356] "Generic (PLEG): container finished" podID="8fbcd4ae-6f3e-4153-a151-58139ae876b4" containerID="ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534" exitCode=0
Jul 29 00:57:11.940694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.940499    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"
Jul 29 00:57:11.940694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.940529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn" event={"ID":"8fbcd4ae-6f3e-4153-a151-58139ae876b4","Type":"ContainerDied","Data":"ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534"}
Jul 29 00:57:11.940694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.940572    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn" event={"ID":"8fbcd4ae-6f3e-4153-a151-58139ae876b4","Type":"ContainerDied","Data":"695d4c1da95d5d3b6e147afe782b4df2a1de4ec772f5ba3d5bd3d5fba640b7c8"}
Jul 29 00:57:11.940694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.940589    2559 scope.go:117] "RemoveContainer" containerID="ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534"
Jul 29 00:57:11.951321 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.951297    2559 scope.go:117] "RemoveContainer" containerID="ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534"
Jul 29 00:57:11.951619 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:57:11.951599    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534\": container with ID starting with ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534 not found: ID does not exist" containerID="ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534"
Jul 29 00:57:11.951733 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.951628    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534"} err="failed to get container status \"ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534\": rpc error: code = NotFound desc = could not find container \"ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534\": container with ID starting with ec824a87312b952b3a8bdae2ab3bd1ba978e9d2a644463f5ef2811dbc1083534 not found: ID does not exist"
Jul 29 00:57:11.976931 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.976904    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-model-cache\") pod \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") "
Jul 29 00:57:11.977089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.976945    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tmp-dir\") pod \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") "
Jul 29 00:57:11.977089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.976980    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tls-certs\") pod \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") "
Jul 29 00:57:11.977089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977049    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-home\") pod \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") "
Jul 29 00:57:11.977089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz8ht\" (UniqueName: \"kubernetes.io/projected/8fbcd4ae-6f3e-4153-a151-58139ae876b4-kube-api-access-mz8ht\") pod \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") "
Jul 29 00:57:11.977306 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977172    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-dshm\") pod \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\" (UID: \"8fbcd4ae-6f3e-4153-a151-58139ae876b4\") "
Jul 29 00:57:11.977306 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977223    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8fbcd4ae-6f3e-4153-a151-58139ae876b4" (UID: "8fbcd4ae-6f3e-4153-a151-58139ae876b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:57:11.977306 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977238    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "8fbcd4ae-6f3e-4153-a151-58139ae876b4" (UID: "8fbcd4ae-6f3e-4153-a151-58139ae876b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:57:11.977446 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977332    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-home" (OuterVolumeSpecName: "home") pod "8fbcd4ae-6f3e-4153-a151-58139ae876b4" (UID: "8fbcd4ae-6f3e-4153-a151-58139ae876b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:57:11.977529 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977511    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:11.977581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977536    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:11.977581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.977552    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:11.979241 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.979219    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8fbcd4ae-6f3e-4153-a151-58139ae876b4" (UID: "8fbcd4ae-6f3e-4153-a151-58139ae876b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:57:11.979346 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.979320    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-dshm" (OuterVolumeSpecName: "dshm") pod "8fbcd4ae-6f3e-4153-a151-58139ae876b4" (UID: "8fbcd4ae-6f3e-4153-a151-58139ae876b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:57:11.979411 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:11.979377    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fbcd4ae-6f3e-4153-a151-58139ae876b4-kube-api-access-mz8ht" (OuterVolumeSpecName: "kube-api-access-mz8ht") pod "8fbcd4ae-6f3e-4153-a151-58139ae876b4" (UID: "8fbcd4ae-6f3e-4153-a151-58139ae876b4"). InnerVolumeSpecName "kube-api-access-mz8ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:57:12.078832 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:12.078790    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8fbcd4ae-6f3e-4153-a151-58139ae876b4-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:12.078832 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:12.078824    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz8ht\" (UniqueName: \"kubernetes.io/projected/8fbcd4ae-6f3e-4153-a151-58139ae876b4-kube-api-access-mz8ht\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:12.078832 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:12.078833    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8fbcd4ae-6f3e-4153-a151-58139ae876b4-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:57:12.263286 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:12.263246    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"]
Jul 29 00:57:12.269009 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:12.268981    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/sub-test-model-12505f-kserve-9c45db965-fgggn"]
Jul 29 00:57:13.010578 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:13.010546    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fbcd4ae-6f3e-4153-a151-58139ae876b4" path="/var/lib/kubelet/pods/8fbcd4ae-6f3e-4153-a151-58139ae876b4/volumes"
Jul 29 00:57:13.011049 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:13.010960    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d94d0f27-ad9d-4eb3-9643-8da7205a3d19" path="/var/lib/kubelet/pods/d94d0f27-ad9d-4eb3-9643-8da7205a3d19/volumes"
Jul 29 00:57:17.508996 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:17.508953    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:17.509475 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:17.509026    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:17.521999 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:17.521969    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:17.983649 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:17.983620    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:57:29.301806 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.301767    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"]
Jul 29 00:57:29.302348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.302329    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94d0f27-ad9d-4eb3-9643-8da7205a3d19" containerName="main"
Jul 29 00:57:29.302518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.302352    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94d0f27-ad9d-4eb3-9643-8da7205a3d19" containerName="main"
Jul 29 00:57:29.302518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.302364    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fbcd4ae-6f3e-4153-a151-58139ae876b4" containerName="main"
Jul 29 00:57:29.302518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.302372    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fbcd4ae-6f3e-4153-a151-58139ae876b4" containerName="main"
Jul 29 00:57:29.302518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.302459    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d94d0f27-ad9d-4eb3-9643-8da7205a3d19" containerName="main"
Jul 29 00:57:29.302518 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.302479    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fbcd4ae-6f3e-4153-a151-58139ae876b4" containerName="main"
Jul 29 00:57:29.305579 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.305558    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.309615 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.309594    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"default-dockercfg-j5fvg\""
Jul 29 00:57:29.309727 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.309594    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"openshift-service-ca.crt\""
Jul 29 00:57:29.309727 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.309628    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"rate-test-model-12505f-kserve-self-signed-certs\""
Jul 29 00:57:29.309727 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.309627    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-12505f\"/\"kube-root-ca.crt\""
Jul 29 00:57:29.313577 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.313486    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"]
Jul 29 00:57:29.325712 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.325640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:57:29.440078 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.440034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-tmp-dir\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.440078 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.440086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edcec344-f71f-463f-bb0e-a76076ad5e1e-tls-certs\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.440304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.440118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vl4q\" (UniqueName: \"kubernetes.io/projected/edcec344-f71f-463f-bb0e-a76076ad5e1e-kube-api-access-4vl4q\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.440304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.440160    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-dshm\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.440304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.440174    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-model-cache\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.440304 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.440213    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-home\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-tmp-dir\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541089 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edcec344-f71f-463f-bb0e-a76076ad5e1e-tls-certs\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541307 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vl4q\" (UniqueName: \"kubernetes.io/projected/edcec344-f71f-463f-bb0e-a76076ad5e1e-kube-api-access-4vl4q\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541307 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-dshm\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541307 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-model-cache\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541444 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541336    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-home\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541517 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541495    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-tmp-dir\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541592 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-model-cache\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.541755 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.541737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-home\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.543659 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.543638    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-dshm\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.543899 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.543882    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edcec344-f71f-463f-bb0e-a76076ad5e1e-tls-certs\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.548834 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.548813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vl4q\" (UniqueName: \"kubernetes.io/projected/edcec344-f71f-463f-bb0e-a76076ad5e1e-kube-api-access-4vl4q\") pod \"rate-test-model-12505f-kserve-67f8db858c-fc8d5\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") " pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.616876 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.616847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:29.751688 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:29.751645    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"]
Jul 29 00:57:29.754051 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:57:29.754022    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedcec344_f71f_463f_bb0e_a76076ad5e1e.slice/crio-c3385663c9dcaf7756f3a61fbea5ffe8badbbd8eb1379927ce566c7ba206b99f WatchSource:0}: Error finding container c3385663c9dcaf7756f3a61fbea5ffe8badbbd8eb1379927ce566c7ba206b99f: Status 404 returned error can't find the container with id c3385663c9dcaf7756f3a61fbea5ffe8badbbd8eb1379927ce566c7ba206b99f
Jul 29 00:57:30.040169 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:30.040070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5" event={"ID":"edcec344-f71f-463f-bb0e-a76076ad5e1e","Type":"ContainerStarted","Data":"aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352"}
Jul 29 00:57:30.040169 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:30.040121    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5" event={"ID":"edcec344-f71f-463f-bb0e-a76076ad5e1e","Type":"ContainerStarted","Data":"c3385663c9dcaf7756f3a61fbea5ffe8badbbd8eb1379927ce566c7ba206b99f"}
Jul 29 00:57:30.057739 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:30.057694    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5" podStartSLOduration=1.057661843 podStartE2EDuration="1.057661843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:57:30.054712857 +0000 UTC m=+2981.619165822" watchObservedRunningTime="2026-07-29 00:57:30.057661843 +0000 UTC m=+2981.622114788"
Jul 29 00:57:39.617629 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:39.617588    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:39.617629 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:39.617636    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:39.630294 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:39.630266    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:40.106242 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:40.106158    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:57:49.157173 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:49.157143    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:57:49.161073 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:49.161052    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:57:49.163313 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:49.163291    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 00:57:49.167434 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:57:49.167417    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 00:58:40.186294 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:40.186210    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"]
Jul 29 00:58:40.196593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:40.196567    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:58:40.989568 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:40.989536    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"]
Jul 29 00:58:41.009388 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:41.009360    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:58:55.205712 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.205652    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9" podUID="d01738bc-f796-482c-9b07-b18656ce9848" containerName="main" containerID="cri-o://4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208" gracePeriod=45
Jul 29 00:58:55.465846 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.465786    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:58:55.489728 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.489700    2559 generic.go:356] "Generic (PLEG): container finished" podID="d01738bc-f796-482c-9b07-b18656ce9848" containerID="4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208" exitCode=0
Jul 29 00:58:55.489877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.489746    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"
Jul 29 00:58:55.489877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.489782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9" event={"ID":"d01738bc-f796-482c-9b07-b18656ce9848","Type":"ContainerDied","Data":"4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208"}
Jul 29 00:58:55.489877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.489825    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9" event={"ID":"d01738bc-f796-482c-9b07-b18656ce9848","Type":"ContainerDied","Data":"423529752d3d14ec00ef41aef0110b7d6ec9e2d18d30eeaa5f2efe7949a88b98"}
Jul 29 00:58:55.489877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.489848    2559 scope.go:117] "RemoveContainer" containerID="4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208"
Jul 29 00:58:55.499363 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.499343    2559 scope.go:117] "RemoveContainer" containerID="4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208"
Jul 29 00:58:55.499636 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:58:55.499616    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208\": container with ID starting with 4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208 not found: ID does not exist" containerID="4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208"
Jul 29 00:58:55.499724 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.499646    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208"} err="failed to get container status \"4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208\": rpc error: code = NotFound desc = could not find container \"4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208\": container with ID starting with 4ea3f05ad9117e9260d4f5644cf2cfbdaa33c85ae507513721f831d2d71e2208 not found: ID does not exist"
Jul 29 00:58:55.634740 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.634644    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-model-cache\") pod \"d01738bc-f796-482c-9b07-b18656ce9848\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") "
Jul 29 00:58:55.634948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.634792    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-tmp-dir\") pod \"d01738bc-f796-482c-9b07-b18656ce9848\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") "
Jul 29 00:58:55.634948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.634830    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-home\") pod \"d01738bc-f796-482c-9b07-b18656ce9848\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") "
Jul 29 00:58:55.634948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.634870    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-dshm\") pod \"d01738bc-f796-482c-9b07-b18656ce9848\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") "
Jul 29 00:58:55.634948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.634905    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj6qx\" (UniqueName: \"kubernetes.io/projected/d01738bc-f796-482c-9b07-b18656ce9848-kube-api-access-tj6qx\") pod \"d01738bc-f796-482c-9b07-b18656ce9848\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") "
Jul 29 00:58:55.634948 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.634912    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-model-cache" (OuterVolumeSpecName: "model-cache") pod "d01738bc-f796-482c-9b07-b18656ce9848" (UID: "d01738bc-f796-482c-9b07-b18656ce9848"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:58:55.635197 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.635032    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d01738bc-f796-482c-9b07-b18656ce9848" (UID: "d01738bc-f796-482c-9b07-b18656ce9848"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:58:55.635197 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.635049    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-home" (OuterVolumeSpecName: "home") pod "d01738bc-f796-482c-9b07-b18656ce9848" (UID: "d01738bc-f796-482c-9b07-b18656ce9848"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:58:55.635197 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.635058    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01738bc-f796-482c-9b07-b18656ce9848-tls-certs\") pod \"d01738bc-f796-482c-9b07-b18656ce9848\" (UID: \"d01738bc-f796-482c-9b07-b18656ce9848\") "
Jul 29 00:58:55.635372 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.635330    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:55.635372 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.635343    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:55.635372 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.635351    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:55.637030 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.637008    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-dshm" (OuterVolumeSpecName: "dshm") pod "d01738bc-f796-482c-9b07-b18656ce9848" (UID: "d01738bc-f796-482c-9b07-b18656ce9848"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:58:55.637115 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.637023    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d01738bc-f796-482c-9b07-b18656ce9848-kube-api-access-tj6qx" (OuterVolumeSpecName: "kube-api-access-tj6qx") pod "d01738bc-f796-482c-9b07-b18656ce9848" (UID: "d01738bc-f796-482c-9b07-b18656ce9848"). InnerVolumeSpecName "kube-api-access-tj6qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:58:55.637115 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.637098    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d01738bc-f796-482c-9b07-b18656ce9848-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d01738bc-f796-482c-9b07-b18656ce9848" (UID: "d01738bc-f796-482c-9b07-b18656ce9848"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:58:55.736207 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.736112    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d01738bc-f796-482c-9b07-b18656ce9848-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:55.736207 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.736148    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d01738bc-f796-482c-9b07-b18656ce9848-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:55.736207 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.736160    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj6qx\" (UniqueName: \"kubernetes.io/projected/d01738bc-f796-482c-9b07-b18656ce9848-kube-api-access-tj6qx\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:55.811029 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.810993    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"]
Jul 29 00:58:55.817232 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:55.817169    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d90846/rate-test-model-d90846-kserve-65bd9bd499-lxqk9"]
Jul 29 00:58:56.009027 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.008913    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5" podUID="edcec344-f71f-463f-bb0e-a76076ad5e1e" containerName="main" containerID="cri-o://aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352" gracePeriod=45
Jul 29 00:58:56.268876 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.268807    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:58:56.442173 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442132    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-dshm\") pod \"edcec344-f71f-463f-bb0e-a76076ad5e1e\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") "
Jul 29 00:58:56.442173 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442173    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-model-cache\") pod \"edcec344-f71f-463f-bb0e-a76076ad5e1e\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") "
Jul 29 00:58:56.442438 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442195    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edcec344-f71f-463f-bb0e-a76076ad5e1e-tls-certs\") pod \"edcec344-f71f-463f-bb0e-a76076ad5e1e\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") "
Jul 29 00:58:56.442438 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442216    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vl4q\" (UniqueName: \"kubernetes.io/projected/edcec344-f71f-463f-bb0e-a76076ad5e1e-kube-api-access-4vl4q\") pod \"edcec344-f71f-463f-bb0e-a76076ad5e1e\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") "
Jul 29 00:58:56.442438 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442234    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-home\") pod \"edcec344-f71f-463f-bb0e-a76076ad5e1e\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") "
Jul 29 00:58:56.442438 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442299    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-tmp-dir\") pod \"edcec344-f71f-463f-bb0e-a76076ad5e1e\" (UID: \"edcec344-f71f-463f-bb0e-a76076ad5e1e\") "
Jul 29 00:58:56.442645 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442544    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-model-cache" (OuterVolumeSpecName: "model-cache") pod "edcec344-f71f-463f-bb0e-a76076ad5e1e" (UID: "edcec344-f71f-463f-bb0e-a76076ad5e1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:58:56.442645 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442557    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-home" (OuterVolumeSpecName: "home") pod "edcec344-f71f-463f-bb0e-a76076ad5e1e" (UID: "edcec344-f71f-463f-bb0e-a76076ad5e1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:58:56.442772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442656    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "edcec344-f71f-463f-bb0e-a76076ad5e1e" (UID: "edcec344-f71f-463f-bb0e-a76076ad5e1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:58:56.442772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442717    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:56.442772 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.442731    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:56.444593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.444566    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edcec344-f71f-463f-bb0e-a76076ad5e1e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "edcec344-f71f-463f-bb0e-a76076ad5e1e" (UID: "edcec344-f71f-463f-bb0e-a76076ad5e1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 00:58:56.444593 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.444565    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-dshm" (OuterVolumeSpecName: "dshm") pod "edcec344-f71f-463f-bb0e-a76076ad5e1e" (UID: "edcec344-f71f-463f-bb0e-a76076ad5e1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 00:58:56.444763 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.444610    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edcec344-f71f-463f-bb0e-a76076ad5e1e-kube-api-access-4vl4q" (OuterVolumeSpecName: "kube-api-access-4vl4q") pod "edcec344-f71f-463f-bb0e-a76076ad5e1e" (UID: "edcec344-f71f-463f-bb0e-a76076ad5e1e"). InnerVolumeSpecName "kube-api-access-4vl4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:58:56.495863 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.495829    2559 generic.go:356] "Generic (PLEG): container finished" podID="edcec344-f71f-463f-bb0e-a76076ad5e1e" containerID="aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352" exitCode=0
Jul 29 00:58:56.496037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.495879    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"
Jul 29 00:58:56.496037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.495924    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5" event={"ID":"edcec344-f71f-463f-bb0e-a76076ad5e1e","Type":"ContainerDied","Data":"aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352"}
Jul 29 00:58:56.496037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.495967    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5" event={"ID":"edcec344-f71f-463f-bb0e-a76076ad5e1e","Type":"ContainerDied","Data":"c3385663c9dcaf7756f3a61fbea5ffe8badbbd8eb1379927ce566c7ba206b99f"}
Jul 29 00:58:56.496037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.495988    2559 scope.go:117] "RemoveContainer" containerID="aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352"
Jul 29 00:58:56.505233 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.505212    2559 scope.go:117] "RemoveContainer" containerID="aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352"
Jul 29 00:58:56.505492 ip-10-0-131-68 kubenswrapper[2559]: E0729 00:58:56.505476    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352\": container with ID starting with aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352 not found: ID does not exist" containerID="aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352"
Jul 29 00:58:56.505544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.505501    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352"} err="failed to get container status \"aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352\": rpc error: code = NotFound desc = could not find container \"aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352\": container with ID starting with aa053c6546a3106c9f325de0f7c142e870abc1975b5552329f627ed6f71dd352 not found: ID does not exist"
Jul 29 00:58:56.516839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.516809    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"]
Jul 29 00:58:56.520488 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.520423    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-12505f/rate-test-model-12505f-kserve-67f8db858c-fc8d5"]
Jul 29 00:58:56.543916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.543891    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:56.543916 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.543914    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/edcec344-f71f-463f-bb0e-a76076ad5e1e-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:56.544070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.543923    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vl4q\" (UniqueName: \"kubernetes.io/projected/edcec344-f71f-463f-bb0e-a76076ad5e1e-kube-api-access-4vl4q\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:56.544070 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:56.543933    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/edcec344-f71f-463f-bb0e-a76076ad5e1e-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:58:57.011296 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.011262    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d01738bc-f796-482c-9b07-b18656ce9848" path="/var/lib/kubelet/pods/d01738bc-f796-482c-9b07-b18656ce9848/volumes"
Jul 29 00:58:57.011653 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.011640    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edcec344-f71f-463f-bb0e-a76076ad5e1e" path="/var/lib/kubelet/pods/edcec344-f71f-463f-bb0e-a76076ad5e1e/volumes"
Jul 29 00:58:57.443068 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.443037    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7666-140519451855872"]
Jul 29 00:58:57.443466 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.443405    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d01738bc-f796-482c-9b07-b18656ce9848" containerName="main"
Jul 29 00:58:57.443466 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.443416    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d01738bc-f796-482c-9b07-b18656ce9848" containerName="main"
Jul 29 00:58:57.443466 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.443436    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edcec344-f71f-463f-bb0e-a76076ad5e1e" containerName="main"
Jul 29 00:58:57.443466 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.443442    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="edcec344-f71f-463f-bb0e-a76076ad5e1e" containerName="main"
Jul 29 00:58:57.443605 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.443502    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d01738bc-f796-482c-9b07-b18656ce9848" containerName="main"
Jul 29 00:58:57.443605 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.443513    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="edcec344-f71f-463f-bb0e-a76076ad5e1e" containerName="main"
Jul 29 00:58:57.447348 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.447333    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451855872"
Jul 29 00:58:57.450409 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.450383    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qn88x\""
Jul 29 00:58:57.452852 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.452828    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451855872"]
Jul 29 00:58:57.554306 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.554264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l87qs\" (UniqueName: \"kubernetes.io/projected/46725a82-a1a8-4b72-933d-744930ecbff1-kube-api-access-l87qs\") pod \"test-curl-7666-140519451855872\" (UID: \"46725a82-a1a8-4b72-933d-744930ecbff1\") " pod="opendatahub/test-curl-7666-140519451855872"
Jul 29 00:58:57.655536 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.655499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l87qs\" (UniqueName: \"kubernetes.io/projected/46725a82-a1a8-4b72-933d-744930ecbff1-kube-api-access-l87qs\") pod \"test-curl-7666-140519451855872\" (UID: \"46725a82-a1a8-4b72-933d-744930ecbff1\") " pod="opendatahub/test-curl-7666-140519451855872"
Jul 29 00:58:57.663902 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.663875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l87qs\" (UniqueName: \"kubernetes.io/projected/46725a82-a1a8-4b72-933d-744930ecbff1-kube-api-access-l87qs\") pod \"test-curl-7666-140519451855872\" (UID: \"46725a82-a1a8-4b72-933d-744930ecbff1\") " pod="opendatahub/test-curl-7666-140519451855872"
Jul 29 00:58:57.758338 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.758234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451855872"
Jul 29 00:58:57.890895 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.890863    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7666-140519451855872"]
Jul 29 00:58:57.892619 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:58:57.892593    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46725a82_a1a8_4b72_933d_744930ecbff1.slice/crio-0e8e2e3a1f1277658387a1390b6f79c5d9a40cb51f07a35c606a518b628d3fe1 WatchSource:0}: Error finding container 0e8e2e3a1f1277658387a1390b6f79c5d9a40cb51f07a35c606a518b628d3fe1: Status 404 returned error can't find the container with id 0e8e2e3a1f1277658387a1390b6f79c5d9a40cb51f07a35c606a518b628d3fe1
Jul 29 00:58:57.894265 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:57.894247    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 00:58:58.509219 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:58.509186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451855872" event={"ID":"46725a82-a1a8-4b72-933d-744930ecbff1","Type":"ContainerStarted","Data":"0e8e2e3a1f1277658387a1390b6f79c5d9a40cb51f07a35c606a518b628d3fe1"}
Jul 29 00:58:59.515811 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:59.515780    2559 generic.go:356] "Generic (PLEG): container finished" podID="46725a82-a1a8-4b72-933d-744930ecbff1" containerID="21ba6a74480a65bc113eb9da699c6e388980545068607b117a92867b9d2dc5e3" exitCode=0
Jul 29 00:58:59.516218 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:58:59.515858    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7666-140519451855872" event={"ID":"46725a82-a1a8-4b72-933d-744930ecbff1","Type":"ContainerDied","Data":"21ba6a74480a65bc113eb9da699c6e388980545068607b117a92867b9d2dc5e3"}
Jul 29 00:59:00.660426 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:00.660399    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451855872"
Jul 29 00:59:00.680967 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:00.680942    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7666-140519451855872_46725a82-a1a8-4b72-933d-744930ecbff1/test-curl-7666-140519451855872/0.log"
Jul 29 00:59:00.705137 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:00.705114    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7666-140519451855872"]
Jul 29 00:59:00.708555 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:00.708530    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7666-140519451855872"]
Jul 29 00:59:00.784266 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:00.784200    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l87qs\" (UniqueName: \"kubernetes.io/projected/46725a82-a1a8-4b72-933d-744930ecbff1-kube-api-access-l87qs\") pod \"46725a82-a1a8-4b72-933d-744930ecbff1\" (UID: \"46725a82-a1a8-4b72-933d-744930ecbff1\") "
Jul 29 00:59:00.786506 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:00.786486    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46725a82-a1a8-4b72-933d-744930ecbff1-kube-api-access-l87qs" (OuterVolumeSpecName: "kube-api-access-l87qs") pod "46725a82-a1a8-4b72-933d-744930ecbff1" (UID: "46725a82-a1a8-4b72-933d-744930ecbff1"). InnerVolumeSpecName "kube-api-access-l87qs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 00:59:00.885186 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:00.885152    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l87qs\" (UniqueName: \"kubernetes.io/projected/46725a82-a1a8-4b72-933d-744930ecbff1-kube-api-access-l87qs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 00:59:01.011481 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.011446    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46725a82-a1a8-4b72-933d-744930ecbff1" path="/var/lib/kubelet/pods/46725a82-a1a8-4b72-933d-744930ecbff1/volumes"
Jul 29 00:59:01.235544 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.235513    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:01.520340 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.520261    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"]
Jul 29 00:59:01.520725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.520684    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46725a82-a1a8-4b72-933d-744930ecbff1" containerName="test-curl-7666-140519451855872"
Jul 29 00:59:01.520725 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.520706    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="46725a82-a1a8-4b72-933d-744930ecbff1" containerName="test-curl-7666-140519451855872"
Jul 29 00:59:01.520927 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.520818    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="46725a82-a1a8-4b72-933d-744930ecbff1" containerName="test-curl-7666-140519451855872"
Jul 29 00:59:01.524160 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.524141    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.526911 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.526893    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-63186d-openshift-default-dockercfg-2vh4k\""
Jul 29 00:59:01.528204 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.528189    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7666-140519451855872"
Jul 29 00:59:01.528302 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.528236    2559 scope.go:117] "RemoveContainer" containerID="21ba6a74480a65bc113eb9da699c6e388980545068607b117a92867b9d2dc5e3"
Jul 29 00:59:01.536244 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.536216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"]
Jul 29 00:59:01.545458 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.545428    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:01.691293 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691244    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-envoy\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.691732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-credential-socket\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.691732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6fa118c-d6e2-46be-891b-60fd4ab55247-istiod-ca-cert\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.691732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691438    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-podinfo\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.691732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgx45\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-kube-api-access-sgx45\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.691732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691507    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-certs\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.691732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-token\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.691732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-socket\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.691732 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.691607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-data\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-credential-socket\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6fa118c-d6e2-46be-891b-60fd4ab55247-istiod-ca-cert\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-podinfo\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792417 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792422    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgx45\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-kube-api-access-sgx45\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792825 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-certs\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792825 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-token\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792825 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792482    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-socket\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792825 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-data\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.792825 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792530    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-envoy\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.793037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.792825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-credential-socket\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.793146 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.793122    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-socket\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.793213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.793149    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-certs\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.793213 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.793195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6fa118c-d6e2-46be-891b-60fd4ab55247-istiod-ca-cert\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.793327 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.793291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-data\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.795096 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.795073    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-envoy\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.795209 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.795192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-podinfo\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.801782 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.801758    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-token\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.802084 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.802061    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgx45\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-kube-api-access-sgx45\") pod \"e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") " pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.838100 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.838057    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:01.916279 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.916248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:01.985998 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.985969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"]
Jul 29 00:59:01.987768 ip-10-0-131-68 kubenswrapper[2559]: W0729 00:59:01.987734    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6fa118c_d6e2_46be_891b_60fd4ab55247.slice/crio-fbf7ecea41b2a725d5e5dafb6efb07390a83e18a873154952cfb86b2b7b12722 WatchSource:0}: Error finding container fbf7ecea41b2a725d5e5dafb6efb07390a83e18a873154952cfb86b2b7b12722: Status 404 returned error can't find the container with id fbf7ecea41b2a725d5e5dafb6efb07390a83e18a873154952cfb86b2b7b12722
Jul 29 00:59:01.990055 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.990025    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:59:01.990136 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.990094    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:59:01.990136 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:01.990125    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:59:02.536858 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:02.536824    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" event={"ID":"f6fa118c-d6e2-46be-891b-60fd4ab55247","Type":"ContainerStarted","Data":"86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b"}
Jul 29 00:59:02.537037 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:02.536873    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" event={"ID":"f6fa118c-d6e2-46be-891b-60fd4ab55247","Type":"ContainerStarted","Data":"fbf7ecea41b2a725d5e5dafb6efb07390a83e18a873154952cfb86b2b7b12722"}
Jul 29 00:59:02.559522 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:02.559460    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" podStartSLOduration=1.559444115 podStartE2EDuration="1.559444115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 00:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 00:59:02.556715826 +0000 UTC m=+3074.121168779" watchObservedRunningTime="2026-07-29 00:59:02.559444115 +0000 UTC m=+3074.123897066"
Jul 29 00:59:02.838650 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:02.838559    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:03.844363 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:03.844332    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:04.505468 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:04.505413    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:04.547067 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:04.547037    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:04.547983 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:04.547961    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:04.584719 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:04.584652    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:04.658313 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:04.658279    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:04.946077 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:04.946036    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:05.160112 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:05.160074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:05.258939 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:05.258847    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:20.589880 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:20.589834    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 00:59:20.590280 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:20.589913    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 00:59:21.642388 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:21.642353    2559 generic.go:356] "Generic (PLEG): container finished" podID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerID="86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b" exitCode=0
Jul 29 00:59:21.642839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:21.642427    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" event={"ID":"f6fa118c-d6e2-46be-891b-60fd4ab55247","Type":"ContainerDied","Data":"86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b"}
Jul 29 00:59:21.642839 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:21.642832    2559 scope.go:117] "RemoveContainer" containerID="86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b"
Jul 29 00:59:21.643883 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:21.643859    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:59:21.643950 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:21.643924    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:59:21.643996 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:21.643957    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 00:59:22.656825 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:22.656791    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" event={"ID":"f6fa118c-d6e2-46be-891b-60fd4ab55247","Type":"ContainerStarted","Data":"35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b"}
Jul 29 00:59:22.838571 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:22.838532    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:22.838797 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:22.838763    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 29 00:59:22.838877 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:22.838819    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 29 00:59:23.839006 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:23.838973    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 29 00:59:23.839399 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:23.839025    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 29 00:59:24.838929 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:24.838894    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 29 00:59:24.839124 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:24.838956    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 29 00:59:25.838742 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:25.838706    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Jul 29 00:59:25.838956 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:25.838758    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Jul 29 00:59:26.842141 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:26.842108    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:26.842581 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:26.842376    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:26.843022 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:26.843003    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 00:59:29.542532 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:29.542502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:30.235747 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:30.235714    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:30.676284 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:30.676250    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:31.382082 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:31.382049    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:33.834487 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:33.834455    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:33.913035 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:33.913000    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:33.996549 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:33.996515    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:34.377694 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:34.377635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:34.584835 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:34.584802    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:34.684267 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:34.684181    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 00:59:58.875285 ip-10-0-131-68 kubenswrapper[2559]: I0729 00:59:58.875230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:00.143301 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.143257    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"]
Jul 29 01:00:00.147156 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.147133    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"]
Jul 29 01:00:00.147333 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.147255    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"
Jul 29 01:00:00.149851 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.149832    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 01:00:00.150193 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.150170    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"]
Jul 29 01:00:00.150290 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.150271    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"
Jul 29 01:00:00.153069 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.153052    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"]
Jul 29 01:00:00.153157 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.153145    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"
Jul 29 01:00:00.156787 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.156770    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96"]
Jul 29 01:00:00.157516 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.156840    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"
Jul 29 01:00:00.160556 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.160533    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"]
Jul 29 01:00:00.160697 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.160622    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96"
Jul 29 01:00:00.161279 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.161259    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"
Jul 29 01:00:00.162445 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.162422    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"]
Jul 29 01:00:00.168702 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.168364    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"]
Jul 29 01:00:00.171896 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.171787    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"]
Jul 29 01:00:00.173021 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.172999    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"
Jul 29 01:00:00.174778 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.174746    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96"]
Jul 29 01:00:00.214427 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.214399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"
Jul 29 01:00:00.227680 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.227583    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"
Jul 29 01:00:00.271476 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.271347    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96"
Jul 29 01:00:00.471403 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.471375    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96"]
Jul 29 01:00:00.472488 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:00:00.472449    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dfaa202_7780_43ef_8c4e_e39fed1aa87c.slice/crio-e0a2354054d91316e18bafa58e11d942d943c45ec3493db2c377c3c592b9fe99 WatchSource:0}: Error finding container e0a2354054d91316e18bafa58e11d942d943c45ec3493db2c377c3c592b9fe99: Status 404 returned error can't find the container with id e0a2354054d91316e18bafa58e11d942d943c45ec3493db2c377c3c592b9fe99
Jul 29 01:00:00.552144 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.552113    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"]
Jul 29 01:00:00.553426 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:00:00.553401    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2e9119_e08e_459b_aad1_ac9c0c238113.slice/crio-db861f93bf1a61392e99179eb5efbbc226b2d28b90a879af54ff55c3c26bee87 WatchSource:0}: Error finding container db861f93bf1a61392e99179eb5efbbc226b2d28b90a879af54ff55c3c26bee87: Status 404 returned error can't find the container with id db861f93bf1a61392e99179eb5efbbc226b2d28b90a879af54ff55c3c26bee87
Jul 29 01:00:00.596782 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.596760    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"]
Jul 29 01:00:00.598071 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:00:00.598049    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0afec6e_1e87_4efc_b54d_bf9e7057d38b.slice/crio-27abbf9d64ea193260212bd8d3709179060ccf92f80fd8f84ff1c0143e4d9f8c WatchSource:0}: Error finding container 27abbf9d64ea193260212bd8d3709179060ccf92f80fd8f84ff1c0143e4d9f8c: Status 404 returned error can't find the container with id 27abbf9d64ea193260212bd8d3709179060ccf92f80fd8f84ff1c0143e4d9f8c
Jul 29 01:00:00.632232 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.632208    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"]
Jul 29 01:00:00.633829 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:00:00.633801    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9a51f9_dd07_4828_ad7e_861d5b501137.slice/crio-af9aad099c33fead94b427fcb15bd12eabd88ca419fb82b8e2450519bebbaeb2 WatchSource:0}: Error finding container af9aad099c33fead94b427fcb15bd12eabd88ca419fb82b8e2450519bebbaeb2: Status 404 returned error can't find the container with id af9aad099c33fead94b427fcb15bd12eabd88ca419fb82b8e2450519bebbaeb2
Jul 29 01:00:00.654884 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.654858    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"]
Jul 29 01:00:00.656532 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:00:00.656501    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod113ba99f_07bc_43f5_9429_832055c5d750.slice/crio-ceeed7f91e70db9da56f17e1d42da4dae63712cf939788cd576ca0f00e98c73a WatchSource:0}: Error finding container ceeed7f91e70db9da56f17e1d42da4dae63712cf939788cd576ca0f00e98c73a: Status 404 returned error can't find the container with id ceeed7f91e70db9da56f17e1d42da4dae63712cf939788cd576ca0f00e98c73a
Jul 29 01:00:00.870395 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.870365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9" event={"ID":"113ba99f-07bc-43f5-9429-832055c5d750","Type":"ContainerStarted","Data":"ceeed7f91e70db9da56f17e1d42da4dae63712cf939788cd576ca0f00e98c73a"}
Jul 29 01:00:00.871967 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.871927    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv" event={"ID":"9c9a51f9-dd07-4828-ad7e-861d5b501137","Type":"ContainerStarted","Data":"af9aad099c33fead94b427fcb15bd12eabd88ca419fb82b8e2450519bebbaeb2"}
Jul 29 01:00:00.873689 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.873454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g" event={"ID":"e0afec6e-1e87-4efc-b54d-bf9e7057d38b","Type":"ContainerStarted","Data":"27abbf9d64ea193260212bd8d3709179060ccf92f80fd8f84ff1c0143e4d9f8c"}
Jul 29 01:00:00.875470 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.875436    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w" event={"ID":"9e2e9119-e08e-459b-aad1-ac9c0c238113","Type":"ContainerStarted","Data":"db861f93bf1a61392e99179eb5efbbc226b2d28b90a879af54ff55c3c26bee87"}
Jul 29 01:00:00.876962 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:00.876941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96" event={"ID":"5dfaa202-7780-43ef-8c4e-e39fed1aa87c","Type":"ContainerStarted","Data":"e0a2354054d91316e18bafa58e11d942d943c45ec3493db2c377c3c592b9fe99"}
Jul 29 01:00:01.888617 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.888579    2559 generic.go:356] "Generic (PLEG): container finished" podID="5dfaa202-7780-43ef-8c4e-e39fed1aa87c" containerID="5b3988e64ffede676f892e9d8dbb07f9b12d924a3e1f2b9256bbaea9280efa00" exitCode=0
Jul 29 01:00:01.889094 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.888684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96" event={"ID":"5dfaa202-7780-43ef-8c4e-e39fed1aa87c","Type":"ContainerDied","Data":"5b3988e64ffede676f892e9d8dbb07f9b12d924a3e1f2b9256bbaea9280efa00"}
Jul 29 01:00:01.890352 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.890326    2559 generic.go:356] "Generic (PLEG): container finished" podID="113ba99f-07bc-43f5-9429-832055c5d750" containerID="8579075a9a45d617f977fff21a7276a90e0950dbfaea3753ca046f0a24201472" exitCode=0
Jul 29 01:00:01.890475 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.890393    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9" event={"ID":"113ba99f-07bc-43f5-9429-832055c5d750","Type":"ContainerDied","Data":"8579075a9a45d617f977fff21a7276a90e0950dbfaea3753ca046f0a24201472"}
Jul 29 01:00:01.891885 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.891859    2559 generic.go:356] "Generic (PLEG): container finished" podID="9c9a51f9-dd07-4828-ad7e-861d5b501137" containerID="fc979a7e251622e20424d3325dccd104fb18df6db194a8cb83130f02d4195639" exitCode=0
Jul 29 01:00:01.891993 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.891929    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv" event={"ID":"9c9a51f9-dd07-4828-ad7e-861d5b501137","Type":"ContainerDied","Data":"fc979a7e251622e20424d3325dccd104fb18df6db194a8cb83130f02d4195639"}
Jul 29 01:00:01.893422 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.893401    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0afec6e-1e87-4efc-b54d-bf9e7057d38b" containerID="c6ffc7b01a819c3acd4859640424ea8bcb20c2630557cc2d55a005e58dd592ed" exitCode=0
Jul 29 01:00:01.893511 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.893496    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g" event={"ID":"e0afec6e-1e87-4efc-b54d-bf9e7057d38b","Type":"ContainerDied","Data":"c6ffc7b01a819c3acd4859640424ea8bcb20c2630557cc2d55a005e58dd592ed"}
Jul 29 01:00:01.894819 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.894798    2559 generic.go:356] "Generic (PLEG): container finished" podID="9e2e9119-e08e-459b-aad1-ac9c0c238113" containerID="7476d2c1b31d2c944bd96beadf73f1bcaf7a8436e5a86b1d5f3fa50fe9c0f79c" exitCode=0
Jul 29 01:00:01.894944 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:01.894827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w" event={"ID":"9e2e9119-e08e-459b-aad1-ac9c0c238113","Type":"ContainerDied","Data":"7476d2c1b31d2c944bd96beadf73f1bcaf7a8436e5a86b1d5f3fa50fe9c0f79c"}
Jul 29 01:00:03.091414 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.091381    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"
Jul 29 01:00:03.136491 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.136422    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"
Jul 29 01:00:03.160713 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.160691    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"
Jul 29 01:00:03.162752 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.162724    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"
Jul 29 01:00:03.166220 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.166198    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96"
Jul 29 01:00:03.908340 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.908311    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"
Jul 29 01:00:03.908642 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.908309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w" event={"ID":"9e2e9119-e08e-459b-aad1-ac9c0c238113","Type":"ContainerDied","Data":"db861f93bf1a61392e99179eb5efbbc226b2d28b90a879af54ff55c3c26bee87"}
Jul 29 01:00:03.908642 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.908468    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db861f93bf1a61392e99179eb5efbbc226b2d28b90a879af54ff55c3c26bee87"
Jul 29 01:00:03.909546 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.909529    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96"
Jul 29 01:00:03.909647 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.909585    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754780-jfj96" event={"ID":"5dfaa202-7780-43ef-8c4e-e39fed1aa87c","Type":"ContainerDied","Data":"e0a2354054d91316e18bafa58e11d942d943c45ec3493db2c377c3c592b9fe99"}
Jul 29 01:00:03.909647 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.909631    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0a2354054d91316e18bafa58e11d942d943c45ec3493db2c377c3c592b9fe99"
Jul 29 01:00:03.911006 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.910990    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"
Jul 29 01:00:03.911006 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.910995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9" event={"ID":"113ba99f-07bc-43f5-9429-832055c5d750","Type":"ContainerDied","Data":"ceeed7f91e70db9da56f17e1d42da4dae63712cf939788cd576ca0f00e98c73a"}
Jul 29 01:00:03.911168 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.911033    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ceeed7f91e70db9da56f17e1d42da4dae63712cf939788cd576ca0f00e98c73a"
Jul 29 01:00:03.912504 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.912481    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"
Jul 29 01:00:03.912614 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.912483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv" event={"ID":"9c9a51f9-dd07-4828-ad7e-861d5b501137","Type":"ContainerDied","Data":"af9aad099c33fead94b427fcb15bd12eabd88ca419fb82b8e2450519bebbaeb2"}
Jul 29 01:00:03.912705 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.912650    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af9aad099c33fead94b427fcb15bd12eabd88ca419fb82b8e2450519bebbaeb2"
Jul 29 01:00:03.913986 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.913963    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g" event={"ID":"e0afec6e-1e87-4efc-b54d-bf9e7057d38b","Type":"ContainerDied","Data":"27abbf9d64ea193260212bd8d3709179060ccf92f80fd8f84ff1c0143e4d9f8c"}
Jul 29 01:00:03.914087 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.914002    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27abbf9d64ea193260212bd8d3709179060ccf92f80fd8f84ff1c0143e4d9f8c"
Jul 29 01:00:03.914087 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:03.913971    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"
Jul 29 01:00:12.252285 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252200    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"]
Jul 29 01:00:12.252693 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252654    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dfaa202-7780-43ef-8c4e-e39fed1aa87c" containerName="cleanup"
Jul 29 01:00:12.252693 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252688    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dfaa202-7780-43ef-8c4e-e39fed1aa87c" containerName="cleanup"
Jul 29 01:00:12.252776 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252704    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e2e9119-e08e-459b-aad1-ac9c0c238113" containerName="cleanup"
Jul 29 01:00:12.252776 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252713    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e2e9119-e08e-459b-aad1-ac9c0c238113" containerName="cleanup"
Jul 29 01:00:12.252776 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252724    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0afec6e-1e87-4efc-b54d-bf9e7057d38b" containerName="cleanup"
Jul 29 01:00:12.252776 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252730    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0afec6e-1e87-4efc-b54d-bf9e7057d38b" containerName="cleanup"
Jul 29 01:00:12.252776 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252738    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="113ba99f-07bc-43f5-9429-832055c5d750" containerName="cleanup"
Jul 29 01:00:12.252776 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252743    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="113ba99f-07bc-43f5-9429-832055c5d750" containerName="cleanup"
Jul 29 01:00:12.252776 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252754    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c9a51f9-dd07-4828-ad7e-861d5b501137" containerName="cleanup"
Jul 29 01:00:12.252776 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252759    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9a51f9-dd07-4828-ad7e-861d5b501137" containerName="cleanup"
Jul 29 01:00:12.253012 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252829    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c9a51f9-dd07-4828-ad7e-861d5b501137" containerName="cleanup"
Jul 29 01:00:12.253012 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252841    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0afec6e-1e87-4efc-b54d-bf9e7057d38b" containerName="cleanup"
Jul 29 01:00:12.253012 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252847    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="113ba99f-07bc-43f5-9429-832055c5d750" containerName="cleanup"
Jul 29 01:00:12.253012 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252852    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dfaa202-7780-43ef-8c4e-e39fed1aa87c" containerName="cleanup"
Jul 29 01:00:12.253012 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.252858    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e2e9119-e08e-459b-aad1-ac9c0c238113" containerName="cleanup"
Jul 29 01:00:12.255940 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.255924    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.258921 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.258889    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-63186d\"/\"openshift-service-ca.crt\""
Jul 29 01:00:12.259777 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.259761    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-63186d\"/\"default-dockercfg-zbzv2\""
Jul 29 01:00:12.260328 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.260307    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-63186d\"/\"kube-root-ca.crt\""
Jul 29 01:00:12.260538 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.260523    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-63186d\"/\"ipp-route-63186d-kserve-self-signed-certs\""
Jul 29 01:00:12.273917 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.273892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"]
Jul 29 01:00:12.301505 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.301464    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:12.332864 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.332834    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq8rw\" (UniqueName: \"kubernetes.io/projected/2a3e24de-29c1-4f0b-9324-c897fbb667d2-kube-api-access-gq8rw\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.333027 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.332886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tmp-dir\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.333027 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.332935    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-dshm\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.333027 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.332999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tls-certs\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.333027 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.333024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-home\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.333184 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.333046    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-model-cache\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.434595 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.434548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq8rw\" (UniqueName: \"kubernetes.io/projected/2a3e24de-29c1-4f0b-9324-c897fbb667d2-kube-api-access-gq8rw\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.434812 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.434654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tmp-dir\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.434812 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.434709    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-dshm\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.434812 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.434766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tls-certs\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.434812 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.434804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-home\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.435052 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.434837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-model-cache\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.435140 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.435116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tmp-dir\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.435483 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.435457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-model-cache\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.435819 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.435792    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-home\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.437935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.437910    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tls-certs\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.438041 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.438001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-dshm\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.446532 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.446488    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq8rw\" (UniqueName: \"kubernetes.io/projected/2a3e24de-29c1-4f0b-9324-c897fbb667d2-kube-api-access-gq8rw\") pod \"ipp-route-63186d-kserve-ffb6c96cf-xztwt\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") " pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.566901 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.566807    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:12.708018 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.707985    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"]
Jul 29 01:00:12.709842 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:00:12.709813    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a3e24de_29c1_4f0b_9324_c897fbb667d2.slice/crio-49b86937c991d9fb0deedb9471f69abd9c3e7ff196a3a33fc67cf8dba254e727 WatchSource:0}: Error finding container 49b86937c991d9fb0deedb9471f69abd9c3e7ff196a3a33fc67cf8dba254e727: Status 404 returned error can't find the container with id 49b86937c991d9fb0deedb9471f69abd9c3e7ff196a3a33fc67cf8dba254e727
Jul 29 01:00:12.970131 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.970092    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt" event={"ID":"2a3e24de-29c1-4f0b-9324-c897fbb667d2","Type":"ContainerStarted","Data":"b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434"}
Jul 29 01:00:12.970310 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.970140    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt" event={"ID":"2a3e24de-29c1-4f0b-9324-c897fbb667d2","Type":"ContainerStarted","Data":"49b86937c991d9fb0deedb9471f69abd9c3e7ff196a3a33fc67cf8dba254e727"}
Jul 29 01:00:12.988074 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:12.988018    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt" podStartSLOduration=0.988004241 podStartE2EDuration="988.004241ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:00:12.986764935 +0000 UTC m=+3144.551217887" watchObservedRunningTime="2026-07-29 01:00:12.988004241 +0000 UTC m=+3144.552457193"
Jul 29 01:00:22.567823 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:22.567776    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:22.568296 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:22.567848    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:22.581904 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:22.581876    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:23.032439 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:23.032405    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:00:24.300557 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:24.300522    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:42.222896 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:42.222861    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:53.443116 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.443076    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:53.742387 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.742303    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"]
Jul 29 01:00:53.747074 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.747052    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.750089 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.750070    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-91da6f-openshift-default-dockercfg-89228\""
Jul 29 01:00:53.757955 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.757928    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"]
Jul 29 01:00:53.821197 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821165    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-token\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.821197 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr7dc\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-kube-api-access-kr7dc\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.821417 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-credential-socket\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.821417 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-podinfo\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.821417 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-envoy\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.821417 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istiod-ca-cert\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.821417 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-socket\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.821716 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-certs\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.821716 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.821537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-data\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922293 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-envoy\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922293 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istiod-ca-cert\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-socket\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-certs\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-data\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-token\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr7dc\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-kube-api-access-kr7dc\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-credential-socket\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-podinfo\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922979 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922815    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-certs\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.922979 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.922861    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-socket\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.923098 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.923024    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-credential-socket\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.923098 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.923071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-data\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.923205 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.923152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istiod-ca-cert\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.924692 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.924650    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-envoy\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.925007 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.924989    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-podinfo\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.941615 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.941593    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-token\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:53.941800 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:53.941779    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr7dc\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-kube-api-access-kr7dc\") pod \"e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") " pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:54.057836 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:54.057752    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:54.213342 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:54.213312    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"]
Jul 29 01:00:54.215074 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:00:54.215047    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9aa3ed_882f_4b5a_b50b_919e0941a589.slice/crio-e8667fa6dc919e62236a2c5623d662b5aab4e8dd6229ab30e30f5db652546572 WatchSource:0}: Error finding container e8667fa6dc919e62236a2c5623d662b5aab4e8dd6229ab30e30f5db652546572: Status 404 returned error can't find the container with id e8667fa6dc919e62236a2c5623d662b5aab4e8dd6229ab30e30f5db652546572
Jul 29 01:00:54.217327 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:54.217296    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 01:00:54.217401 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:54.217361    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 01:00:54.217401 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:54.217390    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 01:00:55.192784 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:55.192745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" event={"ID":"bc9aa3ed-882f-4b5a-b50b-919e0941a589","Type":"ContainerStarted","Data":"7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664"}
Jul 29 01:00:55.193276 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:55.192796    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" event={"ID":"bc9aa3ed-882f-4b5a-b50b-919e0941a589","Type":"ContainerStarted","Data":"e8667fa6dc919e62236a2c5623d662b5aab4e8dd6229ab30e30f5db652546572"}
Jul 29 01:00:55.214937 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:55.214878    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" podStartSLOduration=2.214862433 podStartE2EDuration="2.214862433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:00:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:00:55.212543587 +0000 UTC m=+3186.776996540" watchObservedRunningTime="2026-07-29 01:00:55.214862433 +0000 UTC m=+3186.779315385"
Jul 29 01:00:55.501293 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:55.501205    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:55.555629 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:55.555594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:56.058227 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:56.058191    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:56.063000 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:56.062975    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:56.198980 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:56.198952    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:56.200033 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:56.200016    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:00:57.163520 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:57.163489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:57.265443 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:57.265410    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:57.367146 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:57.367114    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:57.619733 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:57.619705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:57.804517 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:57.804483    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:00:57.901451 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:00:57.901373    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:09.272405 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:09.272367    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerID="7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664" exitCode=0
Jul 29 01:01:09.272860 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:09.272441    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" event={"ID":"bc9aa3ed-882f-4b5a-b50b-919e0941a589","Type":"ContainerDied","Data":"7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664"}
Jul 29 01:01:09.272860 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:09.272855    2559 scope.go:117] "RemoveContainer" containerID="7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664"
Jul 29 01:01:09.273960 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:09.273935    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 01:01:09.274032 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:09.274003    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 01:01:09.274071 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:09.274033    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 29 01:01:10.284875 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:10.284818    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" event={"ID":"bc9aa3ed-882f-4b5a-b50b-919e0941a589","Type":"ContainerStarted","Data":"421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c"}
Jul 29 01:01:11.058589 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:11.058556    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:01:11.060133 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:11.060102    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Jul 29 01:01:11.060402 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:11.060363    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Jul 29 01:01:11.199223 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:11.199180    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:01:12.058384 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:12.058349    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Jul 29 01:01:12.058842 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:12.058405    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Jul 29 01:01:13.059196 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:13.059147    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Jul 29 01:01:13.059764 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:13.059224    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Jul 29 01:01:14.058497 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:14.058456    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Jul 29 01:01:14.058842 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:14.058523    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Jul 29 01:01:15.062384 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:15.062353    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:01:15.063368 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:15.063345    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:01:17.059536 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:17.059503    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:22.133837 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:22.133803    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:22.838868 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:22.838835    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"]
Jul 29 01:01:22.842562 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:22.842545    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"
Jul 29 01:01:22.845462 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:22.845441    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:01:22.845610 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:22.845441    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 01:01:22.850153 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:22.850126    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"]
Jul 29 01:01:22.917829 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:22.917791    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/617d0320-ce9c-488e-89b7-3f4edc0d37bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5\" (UID: \"617d0320-ce9c-488e-89b7-3f4edc0d37bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"
Jul 29 01:01:23.018821 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:23.018792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/617d0320-ce9c-488e-89b7-3f4edc0d37bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5\" (UID: \"617d0320-ce9c-488e-89b7-3f4edc0d37bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"
Jul 29 01:01:23.019411 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:23.019390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/617d0320-ce9c-488e-89b7-3f4edc0d37bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5\" (UID: \"617d0320-ce9c-488e-89b7-3f4edc0d37bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"
Jul 29 01:01:23.154765 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:23.154733    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"
Jul 29 01:01:23.496468 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:23.496443    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"]
Jul 29 01:01:23.497259 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:01:23.497237    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617d0320_ce9c_488e_89b7_3f4edc0d37bb.slice/crio-ebfab334eafd21dc1bfa73d239e11879e071b898f0d0d4383d96fcb74fa54986 WatchSource:0}: Error finding container ebfab334eafd21dc1bfa73d239e11879e071b898f0d0d4383d96fcb74fa54986: Status 404 returned error can't find the container with id ebfab334eafd21dc1bfa73d239e11879e071b898f0d0d4383d96fcb74fa54986
Jul 29 01:01:24.367503 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:24.367467    2559 generic.go:356] "Generic (PLEG): container finished" podID="617d0320-ce9c-488e-89b7-3f4edc0d37bb" containerID="56142c3ba6b373c14ef37c3d1caeb3bfac9f4453724638d9ac60f808650de7f5" exitCode=0
Jul 29 01:01:24.367946 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:24.367511    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5" event={"ID":"617d0320-ce9c-488e-89b7-3f4edc0d37bb","Type":"ContainerDied","Data":"56142c3ba6b373c14ef37c3d1caeb3bfac9f4453724638d9ac60f808650de7f5"}
Jul 29 01:01:24.367946 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:24.367600    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5" event={"ID":"617d0320-ce9c-488e-89b7-3f4edc0d37bb","Type":"ContainerStarted","Data":"ebfab334eafd21dc1bfa73d239e11879e071b898f0d0d4383d96fcb74fa54986"}
Jul 29 01:01:25.511079 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:25.511056    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"
Jul 29 01:01:25.544945 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:25.544917    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/617d0320-ce9c-488e-89b7-3f4edc0d37bb-maas-api-service-ca\") pod \"617d0320-ce9c-488e-89b7-3f4edc0d37bb\" (UID: \"617d0320-ce9c-488e-89b7-3f4edc0d37bb\") "
Jul 29 01:01:25.545195 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:25.545177    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/617d0320-ce9c-488e-89b7-3f4edc0d37bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "617d0320-ce9c-488e-89b7-3f4edc0d37bb" (UID: "617d0320-ce9c-488e-89b7-3f4edc0d37bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:01:25.545373 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:25.545349    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/617d0320-ce9c-488e-89b7-3f4edc0d37bb-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:26.378584 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:26.378550    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"
Jul 29 01:01:26.378780 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:26.378582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5" event={"ID":"617d0320-ce9c-488e-89b7-3f4edc0d37bb","Type":"ContainerDied","Data":"ebfab334eafd21dc1bfa73d239e11879e071b898f0d0d4383d96fcb74fa54986"}
Jul 29 01:01:26.378780 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:26.378627    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebfab334eafd21dc1bfa73d239e11879e071b898f0d0d4383d96fcb74fa54986"
Jul 29 01:01:28.048000 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:28.047965    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:28.104965 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:28.104935    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:28.213713 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:28.213649    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:28.319608 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:28.319523    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"]
Jul 29 01:01:28.325043 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:28.325015    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-91da6f-vf5w5"]
Jul 29 01:01:28.338103 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:28.338074    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:28.660101 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:28.660069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:29.017800 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:29.017715    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="617d0320-ce9c-488e-89b7-3f4edc0d37bb" path="/var/lib/kubelet/pods/617d0320-ce9c-488e-89b7-3f4edc0d37bb/volumes"
Jul 29 01:01:34.446607 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:34.446577    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:34.546713 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:34.546659    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:34.690640 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:34.690608    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"]
Jul 29 01:01:34.690932 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:34.690898    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy" containerID="cri-o://421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c" gracePeriod=30
Jul 29 01:01:34.713740 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:34.713640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:34.945867 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:34.945836    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:39.962366 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:39.962297    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:01:40.083278 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083239    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr7dc\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-kube-api-access-kr7dc\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083449 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083294    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istiod-ca-cert\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083449 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083330    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-token\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083449 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083360    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-data\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083449 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083396    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-socket\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083709 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083479    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-podinfo\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083709 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083513    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-envoy\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083709 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083541    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-certs\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083709 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083571    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-credential-socket\") pod \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\" (UID: \"bc9aa3ed-882f-4b5a-b50b-919e0941a589\") "
Jul 29 01:01:40.083925 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.083801    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:01:40.084068 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.084043    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:01:40.084521 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.084070    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.084769 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.084060    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:01:40.085946 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.084753    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:01:40.086583 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.086550    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-kube-api-access-kr7dc" (OuterVolumeSpecName: "kube-api-access-kr7dc") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "kube-api-access-kr7dc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:01:40.086816 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.086792    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:01:40.089889 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.089839    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:01:40.093303 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.090010    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:01:40.093909 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.093881    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc9aa3ed-882f-4b5a-b50b-919e0941a589" (UID: "bc9aa3ed-882f-4b5a-b50b-919e0941a589"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:01:40.185153 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.185112    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.185153 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.185145    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.185153 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.185153    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.185153 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.185161    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.185425 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.185193    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr7dc\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-kube-api-access-kr7dc\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.185425 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.185203    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.185425 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.185211    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.185425 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.185218    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc9aa3ed-882f-4b5a-b50b-919e0941a589-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:01:40.460148 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.460102    2559 generic.go:356] "Generic (PLEG): container finished" podID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerID="421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c" exitCode=0
Jul 29 01:01:40.460352 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.460166    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"
Jul 29 01:01:40.460352 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.460172    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" event={"ID":"bc9aa3ed-882f-4b5a-b50b-919e0941a589","Type":"ContainerDied","Data":"421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c"}
Jul 29 01:01:40.460352 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.460265    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75" event={"ID":"bc9aa3ed-882f-4b5a-b50b-919e0941a589","Type":"ContainerDied","Data":"e8667fa6dc919e62236a2c5623d662b5aab4e8dd6229ab30e30f5db652546572"}
Jul 29 01:01:40.460352 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.460295    2559 scope.go:117] "RemoveContainer" containerID="421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c"
Jul 29 01:01:40.470562 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.470542    2559 scope.go:117] "RemoveContainer" containerID="7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664"
Jul 29 01:01:40.479577 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.479558    2559 scope.go:117] "RemoveContainer" containerID="421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c"
Jul 29 01:01:40.479874 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:01:40.479839    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c\": container with ID starting with 421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c not found: ID does not exist" containerID="421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c"
Jul 29 01:01:40.479932 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.479882    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c"} err="failed to get container status \"421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c\": rpc error: code = NotFound desc = could not find container \"421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c\": container with ID starting with 421c4c1225455be15b62f2d8cdbba120557749aad0ed743d0ff78b5830588e0c not found: ID does not exist"
Jul 29 01:01:40.479932 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.479900    2559 scope.go:117] "RemoveContainer" containerID="7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664"
Jul 29 01:01:40.480116 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:01:40.480099    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664\": container with ID starting with 7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664 not found: ID does not exist" containerID="7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664"
Jul 29 01:01:40.480170 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.480126    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664"} err="failed to get container status \"7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664\": rpc error: code = NotFound desc = could not find container \"7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664\": container with ID starting with 7bb047b57a021ca0f9edccecd65decec4d1b19b4a13e87b07ccf553cafd19664 not found: ID does not exist"
Jul 29 01:01:40.484478 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.484452    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"]
Jul 29 01:01:40.488712 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:40.488691    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-91da6f-openshift-default-86ddd6b5db-qbl75"]
Jul 29 01:01:41.011788 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:41.011753    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" path="/var/lib/kubelet/pods/bc9aa3ed-882f-4b5a-b50b-919e0941a589/volumes"
Jul 29 01:01:53.784987 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:53.784955    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:53.791518 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:53.791490    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"]
Jul 29 01:01:53.795382 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:53.795359    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-63186d-29754780-xg9dv"]
Jul 29 01:01:53.856122 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:53.856089    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:53.920934 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:53.920901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:54.021457 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:54.021426    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:54.323988 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:54.323948    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:01:55.010636 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:55.010601    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c9a51f9-dd07-4828-ad7e-861d5b501137" path="/var/lib/kubelet/pods/9c9a51f9-dd07-4828-ad7e-861d5b501137/volumes"
Jul 29 01:01:59.303771 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:59.303734    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"]
Jul 29 01:01:59.399382 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:01:59.399349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:14.324073 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.324023    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt" podUID="2a3e24de-29c1-4f0b-9324-c897fbb667d2" containerName="main" containerID="cri-o://b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434" gracePeriod=45
Jul 29 01:02:14.583514 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.583455    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:02:14.646590 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.646557    2559 generic.go:356] "Generic (PLEG): container finished" podID="2a3e24de-29c1-4f0b-9324-c897fbb667d2" containerID="b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434" exitCode=0
Jul 29 01:02:14.646792 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.646630    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"
Jul 29 01:02:14.646792 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.646637    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt" event={"ID":"2a3e24de-29c1-4f0b-9324-c897fbb667d2","Type":"ContainerDied","Data":"b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434"}
Jul 29 01:02:14.646792 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.646715    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt" event={"ID":"2a3e24de-29c1-4f0b-9324-c897fbb667d2","Type":"ContainerDied","Data":"49b86937c991d9fb0deedb9471f69abd9c3e7ff196a3a33fc67cf8dba254e727"}
Jul 29 01:02:14.646792 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.646740    2559 scope.go:117] "RemoveContainer" containerID="b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434"
Jul 29 01:02:14.657215 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.657198    2559 scope.go:117] "RemoveContainer" containerID="b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434"
Jul 29 01:02:14.657493 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:02:14.657476    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434\": container with ID starting with b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434 not found: ID does not exist" containerID="b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434"
Jul 29 01:02:14.657555 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.657503    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434"} err="failed to get container status \"b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434\": rpc error: code = NotFound desc = could not find container \"b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434\": container with ID starting with b5249c3e2e745234b3c67c62c0692f710c70b2cef73845216f6d7c8f915dd434 not found: ID does not exist"
Jul 29 01:02:14.704744 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.704723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-model-cache\") pod \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") "
Jul 29 01:02:14.704853 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.704825    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-home\") pod \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") "
Jul 29 01:02:14.704916 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.704870    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tls-certs\") pod \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") "
Jul 29 01:02:14.704972 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.704926    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-dshm\") pod \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") "
Jul 29 01:02:14.704972 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.704949    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-model-cache" (OuterVolumeSpecName: "model-cache") pod "2a3e24de-29c1-4f0b-9324-c897fbb667d2" (UID: "2a3e24de-29c1-4f0b-9324-c897fbb667d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:14.704972 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.704962    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tmp-dir\") pod \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") "
Jul 29 01:02:14.705126 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.704995    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq8rw\" (UniqueName: \"kubernetes.io/projected/2a3e24de-29c1-4f0b-9324-c897fbb667d2-kube-api-access-gq8rw\") pod \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\" (UID: \"2a3e24de-29c1-4f0b-9324-c897fbb667d2\") "
Jul 29 01:02:14.705126 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.705071    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-home" (OuterVolumeSpecName: "home") pod "2a3e24de-29c1-4f0b-9324-c897fbb667d2" (UID: "2a3e24de-29c1-4f0b-9324-c897fbb667d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:14.705283 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.705248    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2a3e24de-29c1-4f0b-9324-c897fbb667d2" (UID: "2a3e24de-29c1-4f0b-9324-c897fbb667d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:14.705283 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.705286    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-home\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:14.705441 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.705299    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-model-cache\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:14.707259 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.707237    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2a3e24de-29c1-4f0b-9324-c897fbb667d2" (UID: "2a3e24de-29c1-4f0b-9324-c897fbb667d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:02:14.707349 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.707253    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-dshm" (OuterVolumeSpecName: "dshm") pod "2a3e24de-29c1-4f0b-9324-c897fbb667d2" (UID: "2a3e24de-29c1-4f0b-9324-c897fbb667d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:14.707349 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.707258    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a3e24de-29c1-4f0b-9324-c897fbb667d2-kube-api-access-gq8rw" (OuterVolumeSpecName: "kube-api-access-gq8rw") pod "2a3e24de-29c1-4f0b-9324-c897fbb667d2" (UID: "2a3e24de-29c1-4f0b-9324-c897fbb667d2"). InnerVolumeSpecName "kube-api-access-gq8rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:02:14.805949 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.805913    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tls-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:14.805949 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.805953    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-dshm\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:14.806138 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.805993    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a3e24de-29c1-4f0b-9324-c897fbb667d2-tmp-dir\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:14.806138 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.806008    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq8rw\" (UniqueName: \"kubernetes.io/projected/2a3e24de-29c1-4f0b-9324-c897fbb667d2-kube-api-access-gq8rw\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:14.975259 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.975227    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"]
Jul 29 01:02:14.982134 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:14.982110    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-63186d/ipp-route-63186d-kserve-ffb6c96cf-xztwt"]
Jul 29 01:02:15.012071 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:15.012035    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a3e24de-29c1-4f0b-9324-c897fbb667d2" path="/var/lib/kubelet/pods/2a3e24de-29c1-4f0b-9324-c897fbb667d2/volumes"
Jul 29 01:02:35.793408 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:35.793372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:36.233906 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:36.233871    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:41.795471 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:41.795441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:41.860575 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:41.860542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:42.081133 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:42.081032    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"]
Jul 29 01:02:42.081327 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:42.081291    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy" containerID="cri-o://35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b" gracePeriod=30
Jul 29 01:02:42.122337 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:42.122300    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:42.324273 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:42.324239    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:47.346710 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.346637    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 01:02:47.403830 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.403795    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-podinfo\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404004 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.403838    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-credential-socket\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404004 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.403884    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-certs\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404004 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.403910    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-envoy\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404004 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.403939    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-token\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404004 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.403974    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-socket\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404004 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.403997    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-data\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404317 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.404051    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6fa118c-d6e2-46be-891b-60fd4ab55247-istiod-ca-cert\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404317 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.404075    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgx45\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-kube-api-access-sgx45\") pod \"f6fa118c-d6e2-46be-891b-60fd4ab55247\" (UID: \"f6fa118c-d6e2-46be-891b-60fd4ab55247\") "
Jul 29 01:02:47.404317 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.404247    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:47.404317 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.404273    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:47.404538 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.404454    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.404538 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.404475    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.404931 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.404750    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6fa118c-d6e2-46be-891b-60fd4ab55247-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:02:47.404931 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.404765    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:47.405316 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.405283    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:47.406322 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.406291    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:02:47.406431 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.406393    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:02:47.406431 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.406403    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-kube-api-access-sgx45" (OuterVolumeSpecName: "kube-api-access-sgx45") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "kube-api-access-sgx45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:02:47.406518 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.406484    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6fa118c-d6e2-46be-891b-60fd4ab55247" (UID: "f6fa118c-d6e2-46be-891b-60fd4ab55247"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:02:47.505280 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.505236    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.505280 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.505272    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.505280 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.505280    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.505280 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.505290    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.505560 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.505300    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6fa118c-d6e2-46be-891b-60fd4ab55247-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.505560 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.505308    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgx45\" (UniqueName: \"kubernetes.io/projected/f6fa118c-d6e2-46be-891b-60fd4ab55247-kube-api-access-sgx45\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.505560 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.505318    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6fa118c-d6e2-46be-891b-60fd4ab55247-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:02:47.820075 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.820042    2559 generic.go:356] "Generic (PLEG): container finished" podID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerID="35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b" exitCode=0
Jul 29 01:02:47.820261 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.820099    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"
Jul 29 01:02:47.820261 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.820111    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" event={"ID":"f6fa118c-d6e2-46be-891b-60fd4ab55247","Type":"ContainerDied","Data":"35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b"}
Jul 29 01:02:47.820261 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.820159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m" event={"ID":"f6fa118c-d6e2-46be-891b-60fd4ab55247","Type":"ContainerDied","Data":"fbf7ecea41b2a725d5e5dafb6efb07390a83e18a873154952cfb86b2b7b12722"}
Jul 29 01:02:47.820261 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.820182    2559 scope.go:117] "RemoveContainer" containerID="35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b"
Jul 29 01:02:47.833177 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.833118    2559 scope.go:117] "RemoveContainer" containerID="86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b"
Jul 29 01:02:47.842621 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.842602    2559 scope.go:117] "RemoveContainer" containerID="35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b"
Jul 29 01:02:47.843014 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:02:47.842990    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b\": container with ID starting with 35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b not found: ID does not exist" containerID="35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b"
Jul 29 01:02:47.843121 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.843021    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b"} err="failed to get container status \"35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b\": rpc error: code = NotFound desc = could not find container \"35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b\": container with ID starting with 35d1315e202f12cfdfa929143a9e7cf2bda2f2450e9f12429cf98cb274e5e80b not found: ID does not exist"
Jul 29 01:02:47.843121 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.843040    2559 scope.go:117] "RemoveContainer" containerID="86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b"
Jul 29 01:02:47.843306 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:02:47.843290    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b\": container with ID starting with 86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b not found: ID does not exist" containerID="86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b"
Jul 29 01:02:47.843348 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.843310    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b"} err="failed to get container status \"86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b\": rpc error: code = NotFound desc = could not find container \"86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b\": container with ID starting with 86df8543248de140984b5272066dba45435731e2640d62925387e1572fc0420b not found: ID does not exist"
Jul 29 01:02:47.844719 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.844698    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"]
Jul 29 01:02:47.848295 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:47.848271    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-63186d-openshift-default-6cd6bc78db-d2p2m"]
Jul 29 01:02:48.807421 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:48.807387    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:49.011087 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:49.011057    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" path="/var/lib/kubelet/pods/f6fa118c-d6e2-46be-891b-60fd4ab55247/volumes"
Jul 29 01:02:49.189459 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:49.189433    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 01:02:49.193358 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:49.193339    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 01:02:49.196264 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:49.196247    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 01:02:49.200257 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:49.200241    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4htfh_95bfc93f-cb8e-4eee-a61c-a9ff6680fb9c/ovn-acl-logging/0.log"
Jul 29 01:02:53.102449 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:53.102414    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"]
Jul 29 01:02:53.104294 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:53.104271    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-efa6ac-29754780-jj95w"]
Jul 29 01:02:54.192558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:54.192527    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:54.243529 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:54.243497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:02:55.010890 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:55.010858    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e2e9119-e08e-459b-aad1-ac9c0c238113" path="/var/lib/kubelet/pods/9e2e9119-e08e-459b-aad1-ac9c0c238113/volumes"
Jul 29 01:02:58.301482 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:02:58.301441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:00.003729 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.003691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:00.064511 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.064470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:00.306634 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.306547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:00.543572 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.543535    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:00.705598 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.705560    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"]
Jul 29 01:03:00.705985 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.705971    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy"
Jul 29 01:03:00.706040 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.705987    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy"
Jul 29 01:03:00.706040 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.705997    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="617d0320-ce9c-488e-89b7-3f4edc0d37bb" containerName="revoke-keys"
Jul 29 01:03:00.706040 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706002    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="617d0320-ce9c-488e-89b7-3f4edc0d37bb" containerName="revoke-keys"
Jul 29 01:03:00.706040 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706011    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy"
Jul 29 01:03:00.706040 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706017    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy"
Jul 29 01:03:00.706040 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706023    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy"
Jul 29 01:03:00.706040 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706028    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy"
Jul 29 01:03:00.706253 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706043    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a3e24de-29c1-4f0b-9324-c897fbb667d2" containerName="main"
Jul 29 01:03:00.706253 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706048    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a3e24de-29c1-4f0b-9324-c897fbb667d2" containerName="main"
Jul 29 01:03:00.706253 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706101    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy"
Jul 29 01:03:00.706253 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706108    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a3e24de-29c1-4f0b-9324-c897fbb667d2" containerName="main"
Jul 29 01:03:00.706253 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706118    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="617d0320-ce9c-488e-89b7-3f4edc0d37bb" containerName="revoke-keys"
Jul 29 01:03:00.706253 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706124    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy"
Jul 29 01:03:00.706253 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.706129    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy"
Jul 29 01:03:00.708909 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.708893    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"
Jul 29 01:03:00.712277 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.712258    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 01:03:00.712660 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.712643    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:03:00.719936 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.719909    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"]
Jul 29 01:03:00.824067 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.824031    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb5bb9d-0615-4b26-a5e7-98b38100fa70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx\" (UID: \"feb5bb9d-0615-4b26-a5e7-98b38100fa70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"
Jul 29 01:03:00.924477 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.924444    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb5bb9d-0615-4b26-a5e7-98b38100fa70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx\" (UID: \"feb5bb9d-0615-4b26-a5e7-98b38100fa70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"
Jul 29 01:03:00.925117 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:00.925094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb5bb9d-0615-4b26-a5e7-98b38100fa70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx\" (UID: \"feb5bb9d-0615-4b26-a5e7-98b38100fa70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"
Jul 29 01:03:01.019881 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:01.019804    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"
Jul 29 01:03:01.386369 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:01.386340    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"]
Jul 29 01:03:01.387643 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:03:01.387618    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb5bb9d_0615_4b26_a5e7_98b38100fa70.slice/crio-9caf1a97537b590cfc187af362cd691aeee1af5cb35626ee7491b525c1cbe2bf WatchSource:0}: Error finding container 9caf1a97537b590cfc187af362cd691aeee1af5cb35626ee7491b525c1cbe2bf: Status 404 returned error can't find the container with id 9caf1a97537b590cfc187af362cd691aeee1af5cb35626ee7491b525c1cbe2bf
Jul 29 01:03:01.895738 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:01.895700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx" event={"ID":"feb5bb9d-0615-4b26-a5e7-98b38100fa70","Type":"ContainerStarted","Data":"f73b1852fb20b05e44769bb7557420f875bbd5f3b0993b0919d7aafb27730cd5"}
Jul 29 01:03:01.895947 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:01.895758    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx" event={"ID":"feb5bb9d-0615-4b26-a5e7-98b38100fa70","Type":"ContainerStarted","Data":"9caf1a97537b590cfc187af362cd691aeee1af5cb35626ee7491b525c1cbe2bf"}
Jul 29 01:03:01.913290 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:01.913237    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx" podStartSLOduration=1.913222942 podStartE2EDuration="1.913222942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:03:01.910298455 +0000 UTC m=+3313.474751407" watchObservedRunningTime="2026-07-29 01:03:01.913222942 +0000 UTC m=+3313.477675891"
Jul 29 01:03:02.909634 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:02.909581    2559 generic.go:356] "Generic (PLEG): container finished" podID="feb5bb9d-0615-4b26-a5e7-98b38100fa70" containerID="f73b1852fb20b05e44769bb7557420f875bbd5f3b0993b0919d7aafb27730cd5" exitCode=0
Jul 29 01:03:02.910110 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:02.909689    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx" event={"ID":"feb5bb9d-0615-4b26-a5e7-98b38100fa70","Type":"ContainerDied","Data":"f73b1852fb20b05e44769bb7557420f875bbd5f3b0993b0919d7aafb27730cd5"}
Jul 29 01:03:04.056444 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:04.056418    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"
Jul 29 01:03:04.151270 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:04.151229    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb5bb9d-0615-4b26-a5e7-98b38100fa70-maas-api-service-ca\") pod \"feb5bb9d-0615-4b26-a5e7-98b38100fa70\" (UID: \"feb5bb9d-0615-4b26-a5e7-98b38100fa70\") "
Jul 29 01:03:04.151621 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:04.151602    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb5bb9d-0615-4b26-a5e7-98b38100fa70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "feb5bb9d-0615-4b26-a5e7-98b38100fa70" (UID: "feb5bb9d-0615-4b26-a5e7-98b38100fa70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:03:04.252147 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:04.252056    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb5bb9d-0615-4b26-a5e7-98b38100fa70-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:04.924420 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:04.924389    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"
Jul 29 01:03:04.924613 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:04.924427    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx" event={"ID":"feb5bb9d-0615-4b26-a5e7-98b38100fa70","Type":"ContainerDied","Data":"9caf1a97537b590cfc187af362cd691aeee1af5cb35626ee7491b525c1cbe2bf"}
Jul 29 01:03:04.924613 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:04.924502    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9caf1a97537b590cfc187af362cd691aeee1af5cb35626ee7491b525c1cbe2bf"
Jul 29 01:03:05.433327 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:05.433290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:06.950868 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:06.950840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:07.053213 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:07.053184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:11.126162 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.126074    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"]
Jul 29 01:03:11.128261 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.128240    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d90846-29754780-t7r9g"]
Jul 29 01:03:11.130116 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.130094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:11.230816 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.230779    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:11.299315 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.299271    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"]
Jul 29 01:03:11.300551 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.300524    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:11.301280 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.301258    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d90846-rqhgx"]
Jul 29 01:03:11.353875 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.353842    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:11.679375 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:11.679342    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:13.011569 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:13.011536    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0afec6e-1e87-4efc-b54d-bf9e7057d38b" path="/var/lib/kubelet/pods/e0afec6e-1e87-4efc-b54d-bf9e7057d38b/volumes"
Jul 29 01:03:13.011955 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:13.011892    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb5bb9d-0615-4b26-a5e7-98b38100fa70" path="/var/lib/kubelet/pods/feb5bb9d-0615-4b26-a5e7-98b38100fa70/volumes"
Jul 29 01:03:17.495680 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:17.495634    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:17.596226 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:17.596191    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:17.730728 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:17.730696    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"]
Jul 29 01:03:17.730921 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:17.730901    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy" containerID="cri-o://98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a" gracePeriod=30
Jul 29 01:03:17.775229 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:17.775134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:17.979639 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:17.979611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:18.154302 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.154266    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"]
Jul 29 01:03:18.154749 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.154725    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy"
Jul 29 01:03:18.154749 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.154748    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6fa118c-d6e2-46be-891b-60fd4ab55247" containerName="istio-proxy"
Jul 29 01:03:18.154930 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.154761    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb5bb9d-0615-4b26-a5e7-98b38100fa70" containerName="revoke-keys"
Jul 29 01:03:18.154930 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.154767    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb5bb9d-0615-4b26-a5e7-98b38100fa70" containerName="revoke-keys"
Jul 29 01:03:18.154930 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.154843    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb5bb9d-0615-4b26-a5e7-98b38100fa70" containerName="revoke-keys"
Jul 29 01:03:18.154930 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.154857    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc9aa3ed-882f-4b5a-b50b-919e0941a589" containerName="istio-proxy"
Jul 29 01:03:18.158968 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.158949    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"
Jul 29 01:03:18.163124 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.163102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wknvs\""
Jul 29 01:03:18.163229 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.163157    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:03:18.176451 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.176424    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"]
Jul 29 01:03:18.288593 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.288560    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4478503-6fa4-4b80-881a-a9065e96689e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-12505f-vsntk\" (UID: \"c4478503-6fa4-4b80-881a-a9065e96689e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"
Jul 29 01:03:18.389882 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.389852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4478503-6fa4-4b80-881a-a9065e96689e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-12505f-vsntk\" (UID: \"c4478503-6fa4-4b80-881a-a9065e96689e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"
Jul 29 01:03:18.390460 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.390439    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4478503-6fa4-4b80-881a-a9065e96689e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-12505f-vsntk\" (UID: \"c4478503-6fa4-4b80-881a-a9065e96689e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"
Jul 29 01:03:18.470378 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.470286    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"
Jul 29 01:03:18.603806 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:18.603780    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"]
Jul 29 01:03:18.606235 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:03:18.606207    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4478503_6fa4_4b80_881a_a9065e96689e.slice/crio-92d06728259ab9d3fa83157bad6245acf8c83f73a9d46b7bc4a65239e5e17956 WatchSource:0}: Error finding container 92d06728259ab9d3fa83157bad6245acf8c83f73a9d46b7bc4a65239e5e17956: Status 404 returned error can't find the container with id 92d06728259ab9d3fa83157bad6245acf8c83f73a9d46b7bc4a65239e5e17956
Jul 29 01:03:19.002038 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:19.002002    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk" event={"ID":"c4478503-6fa4-4b80-881a-a9065e96689e","Type":"ContainerStarted","Data":"b766f15642632c7a96e54fda40d09a274eb676476f66403c73ee943cf599c3fc"}
Jul 29 01:03:19.002216 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:19.002053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk" event={"ID":"c4478503-6fa4-4b80-881a-a9065e96689e","Type":"ContainerStarted","Data":"92d06728259ab9d3fa83157bad6245acf8c83f73a9d46b7bc4a65239e5e17956"}
Jul 29 01:03:19.017488 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:19.017444    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk" podStartSLOduration=1.017430803 podStartE2EDuration="1.017430803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:03:19.01703348 +0000 UTC m=+3330.581486432" watchObservedRunningTime="2026-07-29 01:03:19.017430803 +0000 UTC m=+3330.581883754"
Jul 29 01:03:20.008724 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:20.008653    2559 generic.go:356] "Generic (PLEG): container finished" podID="c4478503-6fa4-4b80-881a-a9065e96689e" containerID="b766f15642632c7a96e54fda40d09a274eb676476f66403c73ee943cf599c3fc" exitCode=0
Jul 29 01:03:20.009167 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:20.008736    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk" event={"ID":"c4478503-6fa4-4b80-881a-a9065e96689e","Type":"ContainerDied","Data":"b766f15642632c7a96e54fda40d09a274eb676476f66403c73ee943cf599c3fc"}
Jul 29 01:03:21.152700 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:21.152654    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"
Jul 29 01:03:21.317529 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:21.317447    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4478503-6fa4-4b80-881a-a9065e96689e-maas-api-service-ca\") pod \"c4478503-6fa4-4b80-881a-a9065e96689e\" (UID: \"c4478503-6fa4-4b80-881a-a9065e96689e\") "
Jul 29 01:03:21.317849 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:21.317819    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4478503-6fa4-4b80-881a-a9065e96689e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4478503-6fa4-4b80-881a-a9065e96689e" (UID: "c4478503-6fa4-4b80-881a-a9065e96689e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:03:21.418251 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:21.418211    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4478503-6fa4-4b80-881a-a9065e96689e-maas-api-service-ca\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:22.020915 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:22.020882    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"
Jul 29 01:03:22.020915 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:22.020894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk" event={"ID":"c4478503-6fa4-4b80-881a-a9065e96689e","Type":"ContainerDied","Data":"92d06728259ab9d3fa83157bad6245acf8c83f73a9d46b7bc4a65239e5e17956"}
Jul 29 01:03:22.021152 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:22.020935    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92d06728259ab9d3fa83157bad6245acf8c83f73a9d46b7bc4a65239e5e17956"
Jul 29 01:03:22.993474 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:22.993409    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 01:03:23.028568 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.028529    2559 generic.go:356] "Generic (PLEG): container finished" podID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerID="98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a" exitCode=0
Jul 29 01:03:23.028768 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.028575    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"
Jul 29 01:03:23.028768 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.028608    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" event={"ID":"07ac508c-a673-4ca5-a98b-ca431bc25e3a","Type":"ContainerDied","Data":"98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a"}
Jul 29 01:03:23.028768 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.028661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm" event={"ID":"07ac508c-a673-4ca5-a98b-ca431bc25e3a","Type":"ContainerDied","Data":"da3c5bd94a3e0ced3b034fcf5dc250ce678553ca192142770add84f3784ff8be"}
Jul 29 01:03:23.028768 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.028691    2559 scope.go:117] "RemoveContainer" containerID="98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a"
Jul 29 01:03:23.038080 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.038064    2559 scope.go:117] "RemoveContainer" containerID="7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3"
Jul 29 01:03:23.048252 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.048232    2559 scope.go:117] "RemoveContainer" containerID="98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a"
Jul 29 01:03:23.048520 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:03:23.048503    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a\": container with ID starting with 98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a not found: ID does not exist" containerID="98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a"
Jul 29 01:03:23.048588 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.048529    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a"} err="failed to get container status \"98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a\": rpc error: code = NotFound desc = could not find container \"98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a\": container with ID starting with 98c9ef5ae613e6f2e82a8f4ffbc5a24e8ac5d95165650b600826c829db6ae92a not found: ID does not exist"
Jul 29 01:03:23.048588 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.048548    2559 scope.go:117] "RemoveContainer" containerID="7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3"
Jul 29 01:03:23.048854 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:03:23.048837    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3\": container with ID starting with 7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3 not found: ID does not exist" containerID="7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3"
Jul 29 01:03:23.048906 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.048867    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3"} err="failed to get container status \"7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3\": rpc error: code = NotFound desc = could not find container \"7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3\": container with ID starting with 7caf599abce2ed93051152352d1b5226ac826c051ae31fe41d5902b14376c6d3 not found: ID does not exist"
Jul 29 01:03:23.133337 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133297    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-certs\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133524 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133355    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pmsb\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-kube-api-access-8pmsb\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133524 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133383    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-envoy\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133524 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133415    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-credential-socket\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133524 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133450    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-podinfo\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133720 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133560    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istiod-ca-cert\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133720 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133605    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-token\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133720 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133615    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:23.133720 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133637    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-data\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133720 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133710    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-socket\") pod \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\" (UID: \"07ac508c-a673-4ca5-a98b-ca431bc25e3a\") "
Jul 29 01:03:23.133940 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133753    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:23.133996 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.133956    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:03:23.134061 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.134021    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.134061 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.134035    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.134061 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.134048    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.134465 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.134398    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:23.134805 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.134784    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:23.136081 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.136056    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-kube-api-access-8pmsb" (OuterVolumeSpecName: "kube-api-access-8pmsb") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "kube-api-access-8pmsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:03:23.136157 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.136076    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:03:23.136275 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.136257    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:23.136275 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.136261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07ac508c-a673-4ca5-a98b-ca431bc25e3a" (UID: "07ac508c-a673-4ca5-a98b-ca431bc25e3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:03:23.235332 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.235300    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.235332 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.235327    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.235332 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.235336    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.235558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.235344    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.235558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.235352    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pmsb\" (UniqueName: \"kubernetes.io/projected/07ac508c-a673-4ca5-a98b-ca431bc25e3a-kube-api-access-8pmsb\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.235558 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.235361    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07ac508c-a673-4ca5-a98b-ca431bc25e3a-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:23.351727 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.351689    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"]
Jul 29 01:03:23.355840 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:23.355818    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d90846-openshift-default-589568fbd4-wbdzm"]
Jul 29 01:03:25.010822 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:25.010791    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" path="/var/lib/kubelet/pods/07ac508c-a673-4ca5-a98b-ca431bc25e3a/volumes"
Jul 29 01:03:28.553505 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:28.553465    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:28.554008 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:28.553988    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"]
Jul 29 01:03:28.558929 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:28.558906    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-12505f-29754780-vpnx9"]
Jul 29 01:03:28.623752 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:28.623703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:28.691719 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:28.691684    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:28.738201 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:28.738167    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"]
Jul 29 01:03:28.743836 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:28.743807    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-12505f-vsntk"]
Jul 29 01:03:28.759036 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:28.759008    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:29.012148 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:29.012117    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="113ba99f-07bc-43f5-9429-832055c5d750" path="/var/lib/kubelet/pods/113ba99f-07bc-43f5-9429-832055c5d750/volumes"
Jul 29 01:03:29.012428 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:29.012415    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4478503-6fa4-4b80-881a-a9065e96689e" path="/var/lib/kubelet/pods/c4478503-6fa4-4b80-881a-a9065e96689e/volumes"
Jul 29 01:03:29.154056 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:29.154024    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:35.206041 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:35.205984    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:35.306334 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:35.306297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:35.517503 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:35.517402    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"]
Jul 29 01:03:35.517705 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:35.517591    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy" containerID="cri-o://ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47" gracePeriod=30
Jul 29 01:03:35.579387 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:35.579346    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:35.820459 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:35.820367    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:39.210970 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:39.210932    2559 patch_prober.go:28] interesting pod/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:03:39.211371 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:39.211009    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:03:40.779110 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.779049    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 01:03:40.896993 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.896961    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istiod-ca-cert\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897165 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897044    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-socket\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897165 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897100    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbrr4\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-kube-api-access-tbrr4\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897165 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897129    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-credential-socket\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897165 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897150    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-certs\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897380 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897185    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-envoy\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897380 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897214    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-data\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897380 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-token\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897380 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897269    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-podinfo\") pod \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\" (UID: \"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9\") "
Jul 29 01:03:40.897380 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897335    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:40.897649 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897489    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:40.897649 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897519    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:03:40.897649 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897557    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:40.897649 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.897587    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:40.898057 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.898036    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:40.899418 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.899385    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-kube-api-access-tbrr4" (OuterVolumeSpecName: "kube-api-access-tbrr4") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "kube-api-access-tbrr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:03:40.899680 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.899651    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:03:40.900106 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.900078    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:03:40.900106 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.900097    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" (UID: "3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:03:40.998943 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.998908    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbrr4\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-kube-api-access-tbrr4\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:40.998943 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.998936    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-credential-socket\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:40.998943 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.998945    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-workload-certs\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:40.998943 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.998954    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-envoy\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:40.999209 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.998961    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-data\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:40.999209 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.998969    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-token\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:40.999209 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.998977    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istio-podinfo\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:40.999209 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:40.998984    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9-istiod-ca-cert\") on node \"ip-10-0-131-68.ec2.internal\" DevicePath \"\""
Jul 29 01:03:41.128375 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.128346    2559 generic.go:356] "Generic (PLEG): container finished" podID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerID="ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47" exitCode=0
Jul 29 01:03:41.128549 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.128397    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"
Jul 29 01:03:41.128549 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.128429    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" event={"ID":"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9","Type":"ContainerDied","Data":"ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47"}
Jul 29 01:03:41.128549 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.128490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4" event={"ID":"3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9","Type":"ContainerDied","Data":"8530b11dc8d5f62baebddadf8a7d958ae1e517e46a583c3e2e12c7dde6e99059"}
Jul 29 01:03:41.128549 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.128515    2559 scope.go:117] "RemoveContainer" containerID="ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47"
Jul 29 01:03:41.137752 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.137737    2559 scope.go:117] "RemoveContainer" containerID="139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8"
Jul 29 01:03:41.145159 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.145138    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"]
Jul 29 01:03:41.146273 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.146252    2559 scope.go:117] "RemoveContainer" containerID="ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47"
Jul 29 01:03:41.146572 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:03:41.146550    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47\": container with ID starting with ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47 not found: ID does not exist" containerID="ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47"
Jul 29 01:03:41.146623 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.146580    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47"} err="failed to get container status \"ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47\": rpc error: code = NotFound desc = could not find container \"ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47\": container with ID starting with ee24da8fc3f5c62523649d79d74fd340592cecb5b2d8bf2a2ed0e94fc575ce47 not found: ID does not exist"
Jul 29 01:03:41.146623 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.146598    2559 scope.go:117] "RemoveContainer" containerID="139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8"
Jul 29 01:03:41.146846 ip-10-0-131-68 kubenswrapper[2559]: E0729 01:03:41.146827    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8\": container with ID starting with 139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8 not found: ID does not exist" containerID="139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8"
Jul 29 01:03:41.146888 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.146852    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8"} err="failed to get container status \"139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8\": rpc error: code = NotFound desc = could not find container \"139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8\": container with ID starting with 139bcb759bc8d2945e57c40953304ed2af1829e0fbbf8a388a7dd04a50d3f7d8 not found: ID does not exist"
Jul 29 01:03:41.150623 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:41.150604    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-12505f-openshift-default-57b97954c6-jv6l4"]
Jul 29 01:03:42.288589 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:42.288558    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dv99z_ad953eca-4f1b-49f5-82a3-ce2ce97bced2/manager/0.log"
Jul 29 01:03:42.654892 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:42.654865    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc48f86bc-rnj9f_1f1819ab-2293-4b08-a81a-f766dfff8335/copy-manifests/0.log"
Jul 29 01:03:42.660463 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:42.660444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc48f86bc-rnj9f_1f1819ab-2293-4b08-a81a-f766dfff8335/manager/0.log"
Jul 29 01:03:43.011236 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:43.011158    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" path="/var/lib/kubelet/pods/3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9/volumes"
Jul 29 01:03:43.132237 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:43.132209    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754750-dggqf_9fe44157-f120-4a2a-959f-406de45d7d66/cleanup/0.log"
Jul 29 01:03:43.242537 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:43.242511    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754765-97zls_2a45c688-33dc-4806-8179-f0b61d81162c/cleanup/0.log"
Jul 29 01:03:43.355049 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:43.354978    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754780-jfj96_5dfaa202-7780-43ef-8c4e-e39fed1aa87c/cleanup/0.log"
Jul 29 01:03:44.876398 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:44.876367    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6p6lp_4e53ab92-bba1-408c-9824-1153ba18462e/manager/0.log"
Jul 29 01:03:45.005090 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:45.005061    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bdf25_8fd68fea-e153-43d3-9e45-a1874520dfbc/manager/0.log"
Jul 29 01:03:45.236322 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:45.236237    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zzvfv_54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca/registry-server/0.log"
Jul 29 01:03:45.351305 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:45.351257    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fzp92_af4f9e6b-1e24-4110-96ad-6d679734d138/manager/0.log"
Jul 29 01:03:45.580156 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:45.580076    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vldzf_f9c52177-c3bd-40be-b40b-8867c8206f28/manager/0.log"
Jul 29 01:03:45.948181 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:45.948151    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf_0577742a-d11f-4aba-b106-5e5fc1c7ac56/istio-proxy/0.log"
Jul 29 01:03:46.777759 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:46.777730    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5969697cd7-882cd_ab369058-4fb0-464f-94bb-2c987511f3db/router/0.log"
Jul 29 01:03:47.380735 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:47.380704    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-djf28_a5c031c0-dba3-481f-b444-946aee45618d/main/0.log"
Jul 29 01:03:47.720834 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:47.720755    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-pssvs_782d8340-d0da-4add-b971-4632fbc85a7d/main/0.log"
Jul 29 01:03:53.455546 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455511    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dx6mt/must-gather-9q27q"]
Jul 29 01:03:53.455935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455880    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy"
Jul 29 01:03:53.455935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455891    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy"
Jul 29 01:03:53.455935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455900    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4478503-6fa4-4b80-881a-a9065e96689e" containerName="revoke-keys"
Jul 29 01:03:53.455935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455906    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4478503-6fa4-4b80-881a-a9065e96689e" containerName="revoke-keys"
Jul 29 01:03:53.455935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455912    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy"
Jul 29 01:03:53.455935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455918    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy"
Jul 29 01:03:53.455935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455929    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy"
Jul 29 01:03:53.455935 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455934    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy"
Jul 29 01:03:53.456190 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455944    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy"
Jul 29 01:03:53.456190 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.455949    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy"
Jul 29 01:03:53.456190 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.456006    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy"
Jul 29 01:03:53.456190 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.456015    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4478503-6fa4-4b80-881a-a9065e96689e" containerName="revoke-keys"
Jul 29 01:03:53.456190 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.456023    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy"
Jul 29 01:03:53.456190 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.456029    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d0db606-b3d5-48c1-89a9-8c3d5ea4c1f9" containerName="istio-proxy"
Jul 29 01:03:53.456190 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.456134    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="07ac508c-a673-4ca5-a98b-ca431bc25e3a" containerName="istio-proxy"
Jul 29 01:03:53.460842 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.460821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx6mt/must-gather-9q27q"
Jul 29 01:03:53.463483 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.463460    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-dx6mt\"/\"default-dockercfg-xvggr\""
Jul 29 01:03:53.463800 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.463783    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dx6mt\"/\"kube-root-ca.crt\""
Jul 29 01:03:53.463880 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.463861    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-dx6mt\"/\"openshift-service-ca.crt\""
Jul 29 01:03:53.467147 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.467126    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx6mt/must-gather-9q27q"]
Jul 29 01:03:53.474876 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.474855    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:53.580778 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.580748    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log" limit=1024
Jul 29 01:03:53.613914 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.613884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vc6\" (UniqueName: \"kubernetes.io/projected/32680c14-ca5c-4ec1-b7fe-0d029141f212-kube-api-access-m8vc6\") pod \"must-gather-9q27q\" (UID: \"32680c14-ca5c-4ec1-b7fe-0d029141f212\") " pod="openshift-must-gather-dx6mt/must-gather-9q27q"
Jul 29 01:03:53.614070 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.613922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/32680c14-ca5c-4ec1-b7fe-0d029141f212-must-gather-output\") pod \"must-gather-9q27q\" (UID: \"32680c14-ca5c-4ec1-b7fe-0d029141f212\") " pod="openshift-must-gather-dx6mt/must-gather-9q27q"
Jul 29 01:03:53.715304 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.715211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vc6\" (UniqueName: \"kubernetes.io/projected/32680c14-ca5c-4ec1-b7fe-0d029141f212-kube-api-access-m8vc6\") pod \"must-gather-9q27q\" (UID: \"32680c14-ca5c-4ec1-b7fe-0d029141f212\") " pod="openshift-must-gather-dx6mt/must-gather-9q27q"
Jul 29 01:03:53.715304 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.715248    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/32680c14-ca5c-4ec1-b7fe-0d029141f212-must-gather-output\") pod \"must-gather-9q27q\" (UID: \"32680c14-ca5c-4ec1-b7fe-0d029141f212\") " pod="openshift-must-gather-dx6mt/must-gather-9q27q"
Jul 29 01:03:53.715555 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.715535    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/32680c14-ca5c-4ec1-b7fe-0d029141f212-must-gather-output\") pod \"must-gather-9q27q\" (UID: \"32680c14-ca5c-4ec1-b7fe-0d029141f212\") " pod="openshift-must-gather-dx6mt/must-gather-9q27q"
Jul 29 01:03:53.723428 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.723399    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vc6\" (UniqueName: \"kubernetes.io/projected/32680c14-ca5c-4ec1-b7fe-0d029141f212-kube-api-access-m8vc6\") pod \"must-gather-9q27q\" (UID: \"32680c14-ca5c-4ec1-b7fe-0d029141f212\") " pod="openshift-must-gather-dx6mt/must-gather-9q27q"
Jul 29 01:03:53.771618 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.771592    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx6mt/must-gather-9q27q"
Jul 29 01:03:53.904164 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:53.904134    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx6mt/must-gather-9q27q"]
Jul 29 01:03:53.906200 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:03:53.906171    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32680c14_ca5c_4ec1_b7fe_0d029141f212.slice/crio-d1982426f6096ca8a97116d85e2ad4093e14c333601fd5553f704d9883fee522 WatchSource:0}: Error finding container d1982426f6096ca8a97116d85e2ad4093e14c333601fd5553f704d9883fee522: Status 404 returned error can't find the container with id d1982426f6096ca8a97116d85e2ad4093e14c333601fd5553f704d9883fee522
Jul 29 01:03:54.197579 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:54.197548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx6mt/must-gather-9q27q" event={"ID":"32680c14-ca5c-4ec1-b7fe-0d029141f212","Type":"ContainerStarted","Data":"d1982426f6096ca8a97116d85e2ad4093e14c333601fd5553f704d9883fee522"}
Jul 29 01:03:55.205949 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:55.205913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx6mt/must-gather-9q27q" event={"ID":"32680c14-ca5c-4ec1-b7fe-0d029141f212","Type":"ContainerStarted","Data":"b2a153528be3e1fc1621872d2450ed9e9b58aae7e746aee8bd08589e76d30c82"}
Jul 29 01:03:55.206432 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:55.205965    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx6mt/must-gather-9q27q" event={"ID":"32680c14-ca5c-4ec1-b7fe-0d029141f212","Type":"ContainerStarted","Data":"c71f88407dc9f668ecd7d55af8c650321ee3e123bd78e756ad54a09e9a1b6fed"}
Jul 29 01:03:55.226364 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:55.226301    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dx6mt/must-gather-9q27q" podStartSLOduration=1.315593702 podStartE2EDuration="2.226280831s" totalImagesPullingTime="910.687129ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:03:55.2221431 +0000 UTC m=+3366.786596052" watchObservedRunningTime="2026-07-29 01:03:55.226280831 +0000 UTC m=+3366.790733783"
Jul 29 01:03:56.298995 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:56.298961    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bhjtq_e9fa5013-f680-42b7-87a2-4c368f648a14/global-pull-secret-syncer/0.log"
Jul 29 01:03:56.430351 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:56.430326    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6fbtp_0d023894-c69b-42ef-8eb8-ec818b0957d2/konnectivity-agent/0.log"
Jul 29 01:03:56.527866 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:03:56.527828    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-68.ec2.internal_6c5be3bf8d90d1a26a031c410bee150f/haproxy/0.log"
Jul 29 01:04:01.742802 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:01.742764    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-6p6lp_4e53ab92-bba1-408c-9824-1153ba18462e/manager/0.log"
Jul 29 01:04:01.783298 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:01.783264    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bdf25_8fd68fea-e153-43d3-9e45-a1874520dfbc/manager/0.log"
Jul 29 01:04:01.861123 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:01.861087    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zzvfv_54cf5cd7-e4b8-4a7e-8031-d13a7cf735ca/registry-server/0.log"
Jul 29 01:04:02.051284 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:02.051192    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fzp92_af4f9e6b-1e24-4110-96ad-6d679734d138/manager/0.log"
Jul 29 01:04:02.164169 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:02.163828    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vldzf_f9c52177-c3bd-40be-b40b-8867c8206f28/manager/0.log"
Jul 29 01:04:04.259021 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:04.258988    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-qhdvt_5cfe8332-ab5b-49a9-ac64-8af5a9de0224/cluster-monitoring-operator/0.log"
Jul 29 01:04:04.405316 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:04.405276    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-56j2d_f8f7c304-f8e2-44c1-a152-42d816f5b632/node-exporter/0.log"
Jul 29 01:04:04.422256 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:04.422219    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-56j2d_f8f7c304-f8e2-44c1-a152-42d816f5b632/kube-rbac-proxy/0.log"
Jul 29 01:04:04.443088 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:04.443047    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-56j2d_f8f7c304-f8e2-44c1-a152-42d816f5b632/init-textfile/0.log"
Jul 29 01:04:04.836694 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:04.836646    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-jh6wq_dcccc37f-beaa-4e89-912d-20537978940b/prometheus-operator/0.log"
Jul 29 01:04:04.852206 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:04.852182    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-jh6wq_dcccc37f-beaa-4e89-912d-20537978940b/kube-rbac-proxy/0.log"
Jul 29 01:04:04.871416 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:04.871390    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-9gh8j_81a99250-a61c-4578-8fc7-08049a2d60db/prometheus-operator-admission-webhook/0.log"
Jul 29 01:04:06.179203 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.179172    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-2l8pk_fb0f8b2e-7883-4c8d-82d9-948aca6056bc/networking-console-plugin/0.log"
Jul 29 01:04:06.303745 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.303712    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"]
Jul 29 01:04:06.311812 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.311785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.318009 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.317967    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"]
Jul 29 01:04:06.449839 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.449745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-proc\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.450016 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.449865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-sys\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.450016 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.449899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cf66\" (UniqueName: \"kubernetes.io/projected/62e68eca-8c95-4fdb-82ff-c793f969db8f-kube-api-access-2cf66\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.450016 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.449947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-lib-modules\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.450016 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.449991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-podres\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.550624 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.550577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-lib-modules\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.550841 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.550647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-podres\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.550841 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.550774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-proc\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.550970 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.550849    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-sys\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.550970 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.550875    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cf66\" (UniqueName: \"kubernetes.io/projected/62e68eca-8c95-4fdb-82ff-c793f969db8f-kube-api-access-2cf66\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.551092 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.551009    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-podres\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.551092 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.551037    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-proc\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.551203 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.551101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-sys\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.551203 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.551172    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/62e68eca-8c95-4fdb-82ff-c793f969db8f-lib-modules\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.565691 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.560116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cf66\" (UniqueName: \"kubernetes.io/projected/62e68eca-8c95-4fdb-82ff-c793f969db8f-kube-api-access-2cf66\") pod \"perf-node-gather-daemonset-gn549\" (UID: \"62e68eca-8c95-4fdb-82ff-c793f969db8f\") " pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.626406 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.626365    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:06.816909 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.816878    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/1.log"
Jul 29 01:04:06.824929 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.824900    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-s8kkw_03bce739-ff56-4615-9fb1-4d99917f33e4/console-operator/2.log"
Jul 29 01:04:06.831141 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:06.830069    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"]
Jul 29 01:04:06.832934 ip-10-0-131-68 kubenswrapper[2559]: W0729 01:04:06.832902    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62e68eca_8c95_4fdb_82ff_c793f969db8f.slice/crio-45aef71aef00155af6482fa6f2ef9c4a478a617f566e02b8447609b4d19c7931 WatchSource:0}: Error finding container 45aef71aef00155af6482fa6f2ef9c4a478a617f566e02b8447609b4d19c7931: Status 404 returned error can't find the container with id 45aef71aef00155af6482fa6f2ef9c4a478a617f566e02b8447609b4d19c7931
Jul 29 01:04:07.322511 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:07.322422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549" event={"ID":"62e68eca-8c95-4fdb-82ff-c793f969db8f","Type":"ContainerStarted","Data":"a2177f7e8d9ae78dfefe15f0eb66d36496b2f7830599fb861439ad6b62b89bf0"}
Jul 29 01:04:07.322511 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:07.322487    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:07.322511 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:07.322511    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549" event={"ID":"62e68eca-8c95-4fdb-82ff-c793f969db8f","Type":"ContainerStarted","Data":"45aef71aef00155af6482fa6f2ef9c4a478a617f566e02b8447609b4d19c7931"}
Jul 29 01:04:07.339976 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:07.339921    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549" podStartSLOduration=1.339903676 podStartE2EDuration="1.339903676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:04:07.338537247 +0000 UTC m=+3378.902990200" watchObservedRunningTime="2026-07-29 01:04:07.339903676 +0000 UTC m=+3378.904356629"
Jul 29 01:04:07.399824 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:07.399795    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-scw7m_9e21ffe0-f1f0-48bc-a94b-936a7a791c31/download-server/0.log"
Jul 29 01:04:08.009013 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:08.008979    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-zf277_582bfba0-ce13-4268-9002-f4eeba32c98d/volume-data-source-validator/0.log"
Jul 29 01:04:08.964448 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:08.964414    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rjl6p_42c31a85-105c-40f6-91a8-1df2bed84e4a/dns/0.log"
Jul 29 01:04:08.981448 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:08.981424    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rjl6p_42c31a85-105c-40f6-91a8-1df2bed84e4a/kube-rbac-proxy/0.log"
Jul 29 01:04:09.083764 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:09.083739    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4r45s_dd528d51-9db8-40fd-a06c-7b382f9c6393/dns-node-resolver/0.log"
Jul 29 01:04:09.686556 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:09.686524    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ln7s8_65fb6704-d388-47d9-b29b-c69c04bb0f11/node-ca/0.log"
Jul 29 01:04:10.601435 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:10.601408    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf_0577742a-d11f-4aba-b106-5e5fc1c7ac56/istio-proxy/0.log"
Jul 29 01:04:11.089811 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:11.089777    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5969697cd7-882cd_ab369058-4fb0-464f-94bb-2c987511f3db/router/0.log"
Jul 29 01:04:11.887362 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:11.887327    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k55nr_63c265d6-d0f4-47b0-990b-88ecf99a457b/serve-healthcheck-canary/0.log"
Jul 29 01:04:12.420065 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:12.420030    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hqssm_c5c41fee-02ba-4fa3-9969-ced6c7d1f860/insights-operator/0.log"
Jul 29 01:04:12.420475 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:12.420446    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hqssm_c5c41fee-02ba-4fa3-9969-ced6c7d1f860/insights-operator/1.log"
Jul 29 01:04:12.438150 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:12.438127    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wgqx_a0b9f511-d540-4446-af02-fa758f2e10ac/kube-rbac-proxy/0.log"
Jul 29 01:04:12.456941 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:12.456912    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wgqx_a0b9f511-d540-4446-af02-fa758f2e10ac/exporter/0.log"
Jul 29 01:04:12.475319 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:12.475293    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8wgqx_a0b9f511-d540-4446-af02-fa758f2e10ac/extractor/0.log"
Jul 29 01:04:13.343306 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:13.342858    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-dx6mt/perf-node-gather-daemonset-gn549"
Jul 29 01:04:15.435037 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:15.434943    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-dv99z_ad953eca-4f1b-49f5-82a3-ce2ce97bced2/manager/0.log"
Jul 29 01:04:15.616509 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:15.616439    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc48f86bc-rnj9f_1f1819ab-2293-4b08-a81a-f766dfff8335/manager/0.log"
Jul 29 01:04:15.638033 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:15.638005    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc48f86bc-rnj9f_1f1819ab-2293-4b08-a81a-f766dfff8335/copy-manifests/0.log"
Jul 29 01:04:16.944297 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:16.944267    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-794d6b68f4-x2zwj_18f6d213-10ba-4846-842f-f3b5c6cabac1/manager/0.log"
Jul 29 01:04:16.952972 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:16.952948    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf_0577742a-d11f-4aba-b106-5e5fc1c7ac56/istio-proxy/0.log"
Jul 29 01:04:17.390484 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:17.390456    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5969697cd7-882cd_ab369058-4fb0-464f-94bb-2c987511f3db/router/0.log"
Jul 29 01:04:18.709068 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:18.709039    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-54kbf_0577742a-d11f-4aba-b106-5e5fc1c7ac56/istio-proxy/0.log"
Jul 29 01:04:19.163352 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:19.163323    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5969697cd7-882cd_ab369058-4fb0-464f-94bb-2c987511f3db/router/0.log"
Jul 29 01:04:22.186885 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:22.186847    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m_cb692481-489c-4ad6-8e06-26230cca2236/kube-storage-version-migrator-operator/1.log"
Jul 29 01:04:22.188319 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:22.188286    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-cv94m_cb692481-489c-4ad6-8e06-26230cca2236/kube-storage-version-migrator-operator/0.log"
Jul 29 01:04:23.492767 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:23.492733    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf2fm_2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb/kube-multus-additional-cni-plugins/0.log"
Jul 29 01:04:23.512154 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:23.512130    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf2fm_2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb/egress-router-binary-copy/0.log"
Jul 29 01:04:23.532399 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:23.532377    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf2fm_2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb/cni-plugins/0.log"
Jul 29 01:04:23.551948 ip-10-0-131-68 kubenswrapper[2559]: I0729 01:04:23.551922    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zf2fm_2b46184a-f9d7-4b39-ae2f-0b77c9bc3ceb/bond-cni-plugin/0.log"